-- Logs begin at Tue 2022-08-02 08:06:16 UTC, end at Tue 2022-08-02 09:29:43 UTC. -- Aug 02 08:56:49.890989 dv-cinder-847131-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 08:56:49.899649 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 08:56:49 2022] *** Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: nodename: dv-cinder-847131-4-iscsi Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: machine: x86_64 Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: clock source: unix Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: pcre jit disabled Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: detected number of CPU cores: 4 Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: current working directory: / Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: detected binary path: /usr/bin/uwsgi-core Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: your processes number limit is 47680 Aug 02 08:56:49.901662 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: your memory page size is 4096 bytes Aug 02 08:56:49.902555 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: detected max file descriptor number: 2048 Aug 02 08:56:49.902555 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: lock engine: pthread robust mutexes Aug 02 08:56:49.902555 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: thunder lock: enabled Aug 02 08:56:49.902555 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 08:56:49.902555 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 08:56:49.941435 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: Python main interpreter initialized at 0x563f74c439c0 Aug 02 08:56:49.941435 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: python threads support enabled Aug 02 08:56:49.941435 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: your server socket listen backlog is limited to 100 connections Aug 02 08:56:49.941736 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: your mercy for graceful operations on workers is 90 seconds Aug 02 08:56:49.941817 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 08:56:49.941911 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: *** Operational MODE: preforking *** Aug 02 08:56:49.942164 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: *** uWSGI is running in multiple interpreter mode *** Aug 02 08:56:49.942164 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: spawned uWSGI master process (pid: 103826) Aug 02 08:56:49.942363 dv-cinder-847131-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 08:56:49.944628 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: spawned uWSGI worker 1 (pid: 103827, cores: 1) Aug 02 08:56:49.944628 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: spawned uWSGI worker 2 (pid: 103828, cores: 1) Aug 02 08:56:49.944628 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 08:56:50.609409 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 08:56:50.611440 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 08:56:51.711947 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:56:51.711947 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: from cryptography.utils import int_from_bytes Aug 02 08:56:51.712635 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:56:51.712635 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: from cryptography.utils import int_from_bytes Aug 02 08:56:51.732318 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:56:51.732318 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: from cryptography.utils import int_from_bytes Aug 02 08:56:51.732858 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:56:51.732858 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: from cryptography.utils import int_from_bytes Aug 02 08:56:54.367873 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:56:54.368419 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:56:54.368575 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:56:54.368929 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:56:54.369206 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:56:54.370208 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.370533 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.370852 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.371171 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.371636 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.371804 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.372121 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.372437 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.372759 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.373014 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.373326 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.373645 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-4-iscsi {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.373991 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.374298 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.374605 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.374917 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.375216 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.375535 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.375849 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.376341 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.376774 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.377165 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.377486 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.378081 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.378434 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.378747 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.379068 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.379370 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.379694 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.380004 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.380405 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-4-iscsi {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.380721 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.381030 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.381339 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.381749 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.382083 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.382332 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:56:54.382924 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.382924 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.383168 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:56:54.383308 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.383308 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.383523 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:56:54.383640 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.383897 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.384032 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:56:54.384212 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.384336 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:56:54.384529 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.384853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.384976 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.385159 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.385300 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.385465 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.385714 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.385854 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.386093 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.386280 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.386437 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.386629 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.386818 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.386951 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.387217 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.387338 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.387534 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.387852 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.387987 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.388108 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.388333 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.388451 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.388647 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.389045 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.389179 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.389339 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.389506 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.389636 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.389863 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.390063 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.390260 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.390457 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-4-iscsi {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.390627 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.390822 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.390912 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.391143 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.391313 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.391439 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.391551 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.391744 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.391932 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.392053 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.392245 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.392371 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.392572 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.392659 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.392882 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.392977 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.393350 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.393445 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.393598 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.393692 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.393924 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.394016 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.394264 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.394350 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.394577 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.394680 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.394881 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.394968 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.395195 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.395282 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.395512 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.395609 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.395817 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.395911 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.396120 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.396206 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.396422 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.396516 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.396736 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.396821 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-4-iscsi {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.397064 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.397159 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.397363 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.397456 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.397609 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.397710 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.397924 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.398141 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.398231 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.398457 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.398579 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.398770 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.398876 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.399089 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.399182 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.399392 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.399484 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.399687 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.399790 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.399994 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.400088 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.400296 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.400389 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.400628 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.400745 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.401019 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.401121 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.401311 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.401835 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.401972 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402066 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402146 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402223 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402300 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402378 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402463 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402549 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402760 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.402849 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.403011 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.403096 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.403318 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.403406 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.403638 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.403724 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.403938 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.404042 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.404240 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.404327 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.404504 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.404598 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.404755 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.404842 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.405074 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.405174 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.405400 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.405487 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.405708 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.405809 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.406038 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.406127 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.406346 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.406433 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.406665 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.406850 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.406970 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.407082 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.407272 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.407503 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.407624 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.407747 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.407873 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.408006 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.408149 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.408268 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.408455 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.408564 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.408752 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.408852 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.409049 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.409144 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.409348 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.409436 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.409645 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.409771 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.409969 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.410061 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.410266 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.410362 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.410563 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.410656 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.410856 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.410953 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.411166 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.411262 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.411482 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.411576 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.411786 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.411872 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.412085 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.412182 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.412382 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.412468 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.412708 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.412826 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.413048 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.413136 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.413364 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.413451 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.413667 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.413760 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.413937 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.414029 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.414243 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.414341 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.414550 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.414650 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.414866 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.414953 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.415179 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.415264 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.415487 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.415582 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.415792 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.415877 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.416623 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.416729 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.416931 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.417484 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.417804 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.417977 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.418121 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.418212 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.418306 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.418387 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.418465 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.418542 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.418619 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.418697 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.418800 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.418888 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.419063 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.419177 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.419392 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.419487 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.419705 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.419802 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.420028 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.420123 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.420348 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.420451 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.420658 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.420750 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.420966 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.421074 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.421273 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.421376 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.421591 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.421696 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.421918 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.422013 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.422227 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.422333 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.422536 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.422636 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.422841 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.422932 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.423141 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.423242 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.423454 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.423546 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.423762 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.424001 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.424085 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.424163 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.424371 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.424464 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.424669 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.424773 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.424971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.425149 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.425282 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.425392 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.425580 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.425669 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.425908 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.426055 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.426223 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.426377 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.426507 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.426634 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.426816 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.426957 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.427129 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.427260 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.427443 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.427680 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.427830 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.428033 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.428153 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.428332 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.428456 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.428631 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.428806 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.428932 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.429219 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.429347 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.429524 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.429746 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.429919 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.430155 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.430298 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.430483 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.430697 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.430822 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.431105 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.431236 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:56:54.431404 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.431771 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.432424 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.432656 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.432796 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.432964 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.433191 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.433318 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.433565 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.433713 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.433868 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.434096 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.434221 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.434499 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.434629 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.434805 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.435091 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.435218 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.435412 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.435614 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.435737 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.435999 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.436153 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.436311 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.436689 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.436813 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.437004 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.437233 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.437358 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.437609 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.437761 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.437954 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.438267 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.438403 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.438577 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.438854 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.438979 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.439225 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.439400 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.439527 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.439835 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.439961 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.440160 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.440423 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.440574 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.440764 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.440902 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.441073 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.441239 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.441374 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.441574 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.441711 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.441988 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.442134 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.442298 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.442435 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.442599 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.442753 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.442899 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.443152 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.443300 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.443492 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.443621 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.443790 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.443946 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.444108 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.444268 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.444413 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.444597 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.444714 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.444924 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.445010 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.445240 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.445337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.445553 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.445640 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.445872 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.445981 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.446218 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.446306 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.446556 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.446643 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.446872 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.446966 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.447194 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.447289 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.447549 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.447639 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.447865 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.447952 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.448174 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.448269 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.448484 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.448579 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.448791 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.448890 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.449100 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.449194 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.449418 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.449516 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.449726 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.449821 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.450068 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.450170 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.450637 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.450726 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.450951 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.451116 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.451259 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.451358 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.451565 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.451655 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.451865 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.451999 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.452170 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.452262 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.452477 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.452564 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.452791 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.452887 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.453097 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.453192 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.453417 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.453504 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.453725 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.453821 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.454060 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.454149 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.454373 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.454460 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.454683 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.454805 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.454989 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.455109 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.455296 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.455415 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.455611 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.455705 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.455915 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.456009 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.456228 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.456322 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.456533 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.456628 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.456850 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.456938 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.457155 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.457255 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.457470 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.457558 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.457768 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.457855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.458102 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.458206 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.458418 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.458504 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.458725 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.458810 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.459038 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.459133 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.459347 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.459436 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.459658 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.459750 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.459961 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.460059 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.460267 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.460354 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.460579 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.460666 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.460881 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.460976 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.461183 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.461270 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.461489 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.461583 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.461805 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.461942 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.462135 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.462223 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.462442 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.462560 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.462742 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.462861 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.463077 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.463208 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.463381 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.463514 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.463681 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.463827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.463979 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.464133 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.464286 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.464439 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.464601 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.464746 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.464905 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.465055 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.465221 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.465359 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.465537 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.465668 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.465837 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.465998 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.466160 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.466302 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.466477 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.466606 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.466781 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.466927 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.467081 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.467236 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.467382 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.467542 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.467681 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.467846 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.468017 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.468151 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.468324 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.468493 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.468622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.468823 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.468962 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.469156 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.469279 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.469502 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.469635 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.469813 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.469985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.470145 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.470444 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.470569 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.470759 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.470878 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.471090 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.471212 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.471430 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.471555 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.471816 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.472039 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.472168 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.472426 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.472564 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.472735 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.472996 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.473145 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.473493 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.473653 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.473973 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.474123 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.474294 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.474468 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.474591 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.474901 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.475028 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.475349 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.475476 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.475796 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.475931 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.476107 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.476268 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.476422 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.476736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.476871 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.477047 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.477212 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.477372 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.477693 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.477812 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.478068 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.478202 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.478357 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.478485 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.479193 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.479465 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.479584 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.479786 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.479933 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.480093 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.480234 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.480395 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.480528 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.480698 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.480830 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.481002 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.481125 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.481309 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.481435 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.481610 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.481730 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.481926 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.482048 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.482229 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.482349 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.482530 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.482649 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.482841 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.482974 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.483142 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.483261 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.483449 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.483568 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.483750 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.483877 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.484064 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.484183 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.484365 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.484492 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.484666 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.484795 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.484966 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.485084 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.485257 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.485375 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.485590 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.485721 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.485905 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.486041 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.486244 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.486373 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.486552 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.486668 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.486860 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.486980 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.487166 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.487283 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.487463 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.487584 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.487776 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.487892 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.488073 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.488188 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.488372 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.488491 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.488667 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.488794 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.488970 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.489088 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.489275 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.489394 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.489572 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.489699 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.489874 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.490101 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.490229 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.490351 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.490474 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.490596 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.490781 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.490915 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.491084 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.491205 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.491389 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.491507 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.491685 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.491820 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.491995 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.492113 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.492297 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.492422 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.492594 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.492722 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.492876 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.492995 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.493180 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.493298 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.493481 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.493608 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.493776 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.493919 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.494103 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.494240 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.494949 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.495074 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.495262 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.495382 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.495558 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.495678 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.495855 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.495974 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.496151 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.496272 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.496454 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.496574 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.496756 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.496876 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.497052 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.497171 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.497369 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.497488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.497673 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.497792 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.497991 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.498123 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.498281 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.498410 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.498585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.498711 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.498882 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.499004 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.499180 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.499311 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.499482 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.499600 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.499796 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.499912 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.500103 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.500231 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.500401 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.500520 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.500706 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.500820 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.501009 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.501142 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.501310 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.501587 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.501705 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.502052 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.502195 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.502299 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.502412 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.502554 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.502727 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.502858 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.502985 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.503177 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.503298 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.503478 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.503608 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.503796 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.503934 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.504101 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.504218 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.504401 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.504530 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.504703 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.504823 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.505004 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.505123 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.505305 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.505421 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.505615 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.505732 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.505980 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.506098 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.506238 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.506356 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.506542 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.506671 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.506855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.506973 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.507138 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.507268 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.507442 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.507570 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.507743 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.507861 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.508045 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.508163 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.508351 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.508485 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.508651 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.508770 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.508960 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.509078 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.509259 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.509389 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.509558 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.509676 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.509959 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.510102 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.510274 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.510407 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.510583 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.510702 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.510885 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.511001 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.511214 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.511331 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.511517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.511633 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.511823 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.511986 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.512117 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.512232 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.512426 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.512587 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.512731 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.512850 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.513036 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.513155 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.513341 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.513458 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.513649 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.513778 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.513979 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.514101 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.514282 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.514399 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.514588 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.514728 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.514892 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.515014 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.515192 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.515311 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.515500 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.515630 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.515803 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.515933 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.516105 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.516225 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.516413 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.516542 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.516715 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.516835 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.517013 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.517134 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.517311 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.517429 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.517613 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.517731 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.517955 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.518079 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.518257 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.518377 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.518531 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.518652 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.518838 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.518970 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.519144 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.519267 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.519447 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.519578 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.519754 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.519886 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.520059 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.520182 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.520372 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.520493 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.520675 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.520807 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.520978 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.521105 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.521279 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.521399 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.521587 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.521722 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.521906 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.522027 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.522216 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.522342 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.522537 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.522716 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.522879 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.523005 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.523126 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.523242 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.523426 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.523566 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.523732 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.523850 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.524036 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.524169 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.524324 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.524459 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.524633 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.524775 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.524931 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.525044 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.525248 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.525385 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.525578 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.525730 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.525912 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.526066 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.526203 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.526368 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.526514 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.526778 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.526899 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.527086 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.527217 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.527392 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.527513 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.527692 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.527815 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.527996 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.528114 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.528298 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.528416 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.528602 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.528721 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.528912 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.529037 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.529216 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.529332 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.529521 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.529655 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.529825 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.529982 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.530154 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.530272 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.530465 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.530591 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.530768 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.530888 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.531094 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.531214 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.531413 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.531544 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.531724 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.531843 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.532038 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.532205 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.532352 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.532482 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.532664 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.532827 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.532991 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.533111 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.533267 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.533407 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.533579 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.533706 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.533990 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.534116 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.534229 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.534455 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.534572 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.534687 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.534800 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.534920 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.535106 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.535225 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.535416 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.535534 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.535725 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.535841 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.536034 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.536154 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.536341 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.536459 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.536647 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.536765 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.536949 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.537069 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.537251 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.537369 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.537559 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.537675 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.537859 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.538017 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.538200 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.538519 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.538836 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.539183 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.539502 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.539820 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.540022 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.540153 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.540335 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.540471 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.540659 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.540777 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.540970 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.541615 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.541797 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.541975 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.542128 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.542247 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.542432 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.542550 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.542769 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.542942 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.543100 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.543236 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.543377 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.543497 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.543684 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.543801 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.543996 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.544125 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.544304 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.544423 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.544616 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.544745 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.544920 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.545041 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.545239 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.545358 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.545553 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.545674 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.545919 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.546041 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.546185 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.546305 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.546486 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.546622 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.546792 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.546914 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.547093 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.547212 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.547393 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.547520 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.547692 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.547819 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.547996 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.548158 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.548278 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.548473 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.548657 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.548776 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.548889 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.549082 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.549188 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.549509 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.549631 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.549822 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.550049 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.550182 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.550306 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.550471 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.550590 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.550776 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.550895 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.551076 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.551197 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.551416 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.551546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.551723 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.551849 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.552050 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.552171 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.552367 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.552533 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.552684 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.552814 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.553011 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.553141 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.553312 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.553434 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.553623 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.553782 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.553959 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.554124 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.554275 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.554437 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.554587 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.554764 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.554887 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.555086 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.555209 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.555407 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.555537 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.555724 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.555845 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.556039 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.556161 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.556349 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.556469 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.556697 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.557625 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.558006 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.558332 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.558643 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.558973 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.559262 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.559409 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.559597 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.559719 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.559918 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.560237 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.560362 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.560579 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.560721 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.560903 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.561030 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.561223 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.561362 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.561540 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.561669 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.561860 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.562020 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.562193 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.562335 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.562503 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.562694 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.562821 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.562940 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.563102 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.563240 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.563418 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.563544 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.563719 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.563842 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.564034 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.564174 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.564349 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.564475 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.564660 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.564787 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.564965 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.565095 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.565271 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.565398 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.565588 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.565726 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.565942 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.566073 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.566239 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.566365 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.566556 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.566699 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.566879 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.567006 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.567200 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.567340 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.567510 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.567649 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.567832 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.567956 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.568139 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.568272 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.568447 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.568593 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.568813 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.568953 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.569062 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.569168 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.569353 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.569495 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.569661 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.569790 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.569997 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.570124 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.570309 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.570448 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.570631 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.570768 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.570942 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.571068 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.571276 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.571403 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.571644 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.571782 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.571955 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.572081 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.572271 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.572920 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.573119 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.573418 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.573549 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.573722 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.573850 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.574064 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.574202 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.574339 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.574461 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.574646 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.574773 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.574951 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.575088 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.575526 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.575655 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.575835 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.576036 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.576163 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.576295 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.576417 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.576539 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.576739 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.576868 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.577045 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.577223 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.577352 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.577583 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.577710 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.577844 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.577997 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.578138 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.578270 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.578403 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.578529 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.578649 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.578840 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.579021 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.579195 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.579368 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.579531 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.579713 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.579839 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.580028 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.580154 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.580348 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.580473 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.580665 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.580787 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.580978 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.581114 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.581282 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.581399 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.581601 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.581722 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.581941 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.582080 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.582226 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.582346 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.582537 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.582658 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.582845 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.582977 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.583165 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.583297 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.583467 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.583649 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.583790 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.583928 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.584059 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.584182 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.584302 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.584424 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.584597 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.584896 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.585016 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.585219 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.585338 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.585520 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.585649 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.585821 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.585971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.586148 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.586275 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.586455 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.586585 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.586756 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.586875 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.587054 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.587180 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.587341 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.587478 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.587642 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.587762 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.587980 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.588593 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.588856 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.588985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.589145 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.589264 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.589450 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.589579 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.589756 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.589876 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.590082 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.590215 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.590386 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.590513 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.590730 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.590858 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.591049 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.591168 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.591350 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.591479 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.591650 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.591769 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.591961 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.592082 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.592266 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.592399 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.592584 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.592711 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.592894 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.593022 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.593201 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.593330 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.593512 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.593629 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.593827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.593979 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.594166 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.594431 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.594553 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.594767 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.594888 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.595089 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.595219 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.595406 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.595524 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.595730 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.595850 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.596065 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.596201 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.596388 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.596506 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.596703 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.596821 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.597040 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.597169 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.597359 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.597532 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.597698 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.597955 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.598095 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.598249 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.598368 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.598583 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.598700 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.598909 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.599039 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.599216 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.599333 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.599523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.599642 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.599833 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.599965 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.600140 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.600258 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.600446 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.600566 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.600748 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.600866 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.601057 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.601193 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.601361 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.601479 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.601663 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.601783 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.602007 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.602144 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.602320 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.602438 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.602626 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.602763 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.602938 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.603056 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.603244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.603372 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.603575 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.603809 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.603942 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.604162 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.604282 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.604479 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.604605 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.604791 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.604922 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.605117 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.605251 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.605429 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.605552 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.605733 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.605854 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.606068 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.606186 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.606375 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.606501 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.606682 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.606821 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.606998 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.607234 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.607362 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.607478 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.607588 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.607701 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.607895 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.608028 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.608205 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.608335 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.608512 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.608638 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.608815 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.608960 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.609124 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.609249 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.609428 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.609554 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.609754 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.609912 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.610084 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.610245 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.610376 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.610499 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.610676 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.610815 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.610987 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.611113 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.611290 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.611412 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.611591 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.611716 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.611895 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.612021 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.612199 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.612322 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.612494 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.612620 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.612796 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.612931 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.613093 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.613233 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.613394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.613518 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.613694 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.613926 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.614054 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.614206 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.614339 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.614530 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.614670 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.614876 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.615011 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.615174 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.615419 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.615541 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.615754 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.615934 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.616057 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.616341 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.616465 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.616641 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.616941 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.617063 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.617241 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.617472 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.617596 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.617826 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.618107 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.618250 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.618496 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.618620 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.618810 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.619074 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.619222 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.619453 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.619654 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.619776 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.620064 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.620188 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.620385 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.620701 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.620855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.621013 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.621197 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.621320 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.621522 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.621651 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.621864 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.622014 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.622222 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.622310 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.622534 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.622630 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.622842 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.622929 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.623150 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.623237 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.623459 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.623604 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.623775 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.623900 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.624087 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.624175 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.624390 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.624485 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.624702 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.624787 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.625013 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.625100 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.625327 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.625414 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.625641 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.625742 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.625978 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.626107 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.626301 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.626423 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.626609 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.626728 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.626917 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.627045 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.627223 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.627343 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.627528 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.627648 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.627837 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.627972 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.628149 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.628267 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.628456 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.628575 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.628762 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.628891 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.629074 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.629193 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.629386 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.629510 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.629707 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.629835 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.630050 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.630191 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.630358 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.630477 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.630667 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.630794 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.630981 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.631110 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.631300 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.631418 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.631618 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.631745 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.631929 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.632047 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.632236 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.632355 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.632562 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.632680 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.632870 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.632989 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.633172 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.633300 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.633425 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:56:54.633572 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.633903 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.634229 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.634552 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.635385 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.635705 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.636036 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.636363 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.636704 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.637031 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.637362 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.637666 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.637998 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.638304 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.638633 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.638955 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.639265 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.639567 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.639871 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.640178 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.640484 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.640788 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.641090 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.641393 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.641700 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.642028 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.642336 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.642638 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.643038 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.643468 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.643779 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.644100 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.644420 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.644699 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.645005 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.645309 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.645615 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.645977 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.646312 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.646646 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.646991 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.647305 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.647654 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.647981 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.648282 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.648603 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.648922 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.649232 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.649565 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.649878 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.650211 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.651066 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.651387 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.651719 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.652029 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.652376 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.652844 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.653306 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.653643 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.653991 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.654311 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.654628 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.654940 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.655267 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.655597 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.656099 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.656599 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.657105 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.657592 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.658135 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.658762 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.659102 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.659590 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.660094 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.660606 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.661081 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.661513 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.662020 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.662586 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.663169 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.663679 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.664138 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.664516 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.664835 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.665152 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.665460 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:56:54.665707 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:56:54.795263 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO dbcounter [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Registered counter for database nova_api Aug 02 08:56:54.818111 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_db.sqlalchemy.engines [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:56:54.824820 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writer thread running {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:56:54.829499 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO dbcounter [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Registered counter for database nova_api Aug 02 08:56:54.850291 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG oslo_db.sqlalchemy.engines [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:56:54.857469 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writer thread running {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:56:54.881158 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.context [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5fe5474-0e15-44e4-8276-d3b5e9f77338(cell1) {{(pid=103828) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 08:56:54.885071 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:54.886669 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:54.887469 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:54.889429 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:54.891453 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO dbcounter [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Registered counter for database nova_cell0 Aug 02 08:56:54.897178 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO dbcounter [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Registered counter for database nova_cell1 Aug 02 08:56:54.905953 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_db.sqlalchemy.engines [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:56:54.908277 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_db.sqlalchemy.engines [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:56:54.913333 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writer thread running {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:56:54.915461 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.context [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5fe5474-0e15-44e4-8276-d3b5e9f77338(cell1) {{(pid=103827) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 08:56:54.919109 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writer thread running {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:56:54.920198 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG oslo_concurrency.lockutils [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:54.921867 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG oslo_concurrency.lockutils [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:54.922667 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG oslo_concurrency.lockutils [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:56:54.924695 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG oslo_concurrency.lockutils [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:56:54.926770 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO dbcounter [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Registered counter for database nova_cell0 Aug 02 08:56:54.932541 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO dbcounter [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Registered counter for database nova_cell1 Aug 02 08:56:54.940135 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG oslo_db.sqlalchemy.engines [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:56:54.945247 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG oslo_db.sqlalchemy.engines [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:56:54.945916 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writer thread running {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:56:55.065504 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO dbcounter [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Registered counter for database nova_cell0 Aug 02 08:56:55.073506 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_db.sqlalchemy.engines [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:56:55.078105 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writer thread running {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:56:55.094971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writer thread running {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:56:55.105046 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO dbcounter [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Registered counter for database nova_cell0 Aug 02 08:56:55.114933 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG oslo_db.sqlalchemy.engines [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:56:55.119432 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writer thread running {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:56:55.490618 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: WARNING keystonemiddleware.auth_token [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:56:55.498137 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: WARNING keystonemiddleware.auth_token [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:56:55.523274 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: WARNING keystonemiddleware.auth_token [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:56:55.531697 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: WARNING keystonemiddleware.auth_token [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:56:55.856212 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: WARNING keystonemiddleware.auth_token [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:56:55.862399 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: WARNING keystonemiddleware.auth_token [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:56:55.867722 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f74c439c0 pid: 103828 (default app) Aug 02 08:56:55.870507 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:56:55.871702 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002438 Aug 02 08:56:55.872109 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Tue Aug 2 08:56:55 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:56:55.876164 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: WARNING keystonemiddleware.auth_token [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 08:56:55.882575 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: WARNING keystonemiddleware.auth_token [None req-61de0958-41ad-4abe-aadb-0063d7334216 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 08:56:55.887958 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f74c439c0 pid: 103827 (default app) Aug 02 08:58:24.735558 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:24.737269 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002643 Aug 02 08:58:24.737989 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:24.759318 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writing DB stats nova_api:SELECT=3 {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:24.761699 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writing DB stats nova_cell0:SELECT=3 {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:24.762986 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writing DB stats nova_cell1:SELECT=3 {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:24.764668 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:25.701976 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-cd99c5dc-8978-4ef3-bbe5-475fc8df6eff admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:25.734637 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-cd99c5dc-8978-4ef3-bbe5-475fc8df6eff admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.984620 Aug 02 08:58:25.735370 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Aug 2 08:58:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:28.033227 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:28.034346 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-c512677d-01c7-4463-b383-07c2ddbb1be8 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 02 08:58:28.034713 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:28.670056 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-49bc3a0e-e45b-490b-be36-fe1948ee0081 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:28.692867 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:58:28.692867 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: warnings.warn(msg) Aug 02 08:58:28.785940 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-49bc3a0e-e45b-490b-be36-fe1948ee0081 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.745133 Aug 02 08:58:28.786821 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:58:28.800583 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_api:SELECT=3 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:28.801643 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_cell1:SELECT=3 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:28.802655 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_cell0:SELECT=3 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:28.803508 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:29.015883 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-2c81c056-ace0-4b75-8963-1180e876c841 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:29.020405 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:58:29.020405 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: warnings.warn(msg) Aug 02 08:58:29.168451 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-2c81c056-ace0-4b75-8963-1180e876c841 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.372603 Aug 02 08:58:29.169142 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Aug 2 08:58:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:58:31.630156 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-49bc3a0e-e45b-490b-be36-fe1948ee0081 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:31.631591 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-49bc3a0e-e45b-490b-be36-fe1948ee0081 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001826 Aug 02 08:58:31.632225 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:32.495386 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-e6055e55-1921-4f73-a2f3-0948b6a703dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "disk": 5}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:32.514791 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:58:32.514791 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: warnings.warn(msg) Aug 02 08:58:32.659518 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-e6055e55-1921-4f73-a2f3-0948b6a703dc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.019485 Aug 02 08:58:32.660608 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:58:32.683781 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-8564bcfd-aa0a-4f9c-a21e-3f6d1aa6b117 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:32.689796 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:58:32.689796 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: warnings.warn(msg) Aug 02 08:58:32.824513 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-8564bcfd-aa0a-4f9c-a21e-3f6d1aa6b117 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147268 Aug 02 08:58:32.825450 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Aug 2 08:58:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:35.485615 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-e6055e55-1921-4f73-a2f3-0948b6a703dc admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:35.495126 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-e6055e55-1921-4f73-a2f3-0948b6a703dc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006963 Aug 02 08:58:35.496435 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:36.041767 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-4b2a976d-9611-4927-8766-afb920b0ee31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:36.128180 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-4b2a976d-9611-4927-8766-afb920b0ee31 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.623885 Aug 02 08:58:36.128775 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:58:36.142007 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-e35fff40-6d4e-4916-a13d-c04007e5846d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:36.222379 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-e35fff40-6d4e-4916-a13d-c04007e5846d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084358 Aug 02 08:58:36.222887 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Aug 2 08:58:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:38.576030 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-4b2a976d-9611-4927-8766-afb920b0ee31 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:38.579016 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-4b2a976d-9611-4927-8766-afb920b0ee31 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002202 Aug 02 08:58:38.579016 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:39.202148 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-1205aec6-818b-4c4e-a91d-68e9df1c916b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:39.293905 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-1205aec6-818b-4c4e-a91d-68e9df1c916b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706692 Aug 02 08:58:39.294833 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:58:39.308406 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a67a374c-9f17-483a-a4e3-f2f8252450b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:39.420480 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a67a374c-9f17-483a-a4e3-f2f8252450b5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116319 Aug 02 08:58:39.421355 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Aug 2 08:58:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:41.908672 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-1205aec6-818b-4c4e-a91d-68e9df1c916b admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:41.909659 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-1205aec6-818b-4c4e-a91d-68e9df1c916b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 02 08:58:41.910097 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:42.446210 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-ee5da160-32f0-4e2d-874b-030ee666e3fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:42.574591 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-ee5da160-32f0-4e2d-874b-030ee666e3fb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.657115 Aug 02 08:58:42.581524 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 08:58:42.588809 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-e689865f-b284-4db6-9a37-61f156f7555c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:42.707762 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-e689865f-b284-4db6-9a37-61f156f7555c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123541 Aug 02 08:58:42.708865 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Aug 2 08:58:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:45.157240 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-ee5da160-32f0-4e2d-874b-030ee666e3fb admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:45.158333 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-ee5da160-32f0-4e2d-874b-030ee666e3fb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Aug 02 08:58:45.158851 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:45.624553 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-0ad38b46-f437-4274-8c0e-702e23a4036a admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:45.651656 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-0ad38b46-f437-4274-8c0e-702e23a4036a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.484116 Aug 02 08:58:45.652248 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Aug 2 08:58:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:58:48.093767 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-ee5da160-32f0-4e2d-874b-030ee666e3fb admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:48.094858 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-ee5da160-32f0-4e2d-874b-030ee666e3fb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 02 08:58:48.095260 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:48.687945 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-2eb8d8bc-d074-42ab-8be5-e1eb587d01c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:48.778268 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-2eb8d8bc-d074-42ab-8be5-e1eb587d01c8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.675101 Aug 02 08:58:48.778868 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 08:58:48.792542 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-8a35200f-18f0-41c7-85aa-07984ddb211a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:48.872686 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-8a35200f-18f0-41c7-85aa-07984ddb211a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084209 Aug 02 08:58:48.873278 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Aug 2 08:58:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:51.219705 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-2eb8d8bc-d074-42ab-8be5-e1eb587d01c8 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:51.220637 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-2eb8d8bc-d074-42ab-8be5-e1eb587d01c8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 02 08:58:51.221039 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:58:51.712155 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-9ffaa690-1cf3-47b7-8cec-2f2f2b8bcabc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "id": "2"}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:51.802795 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-9ffaa690-1cf3-47b7-8cec-2f2f2b8bcabc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.574558 Aug 02 08:58:51.803271 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:58:51.816190 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-9b9f7ab8-fbf3-400b-8e22-a8009fd4748a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:51.983889 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-9b9f7ab8-fbf3-400b-8e22-a8009fd4748a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.171583 Aug 02 08:58:52.013038 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Aug 2 08:58:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:54.286856 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-9ffaa690-1cf3-47b7-8cec-2f2f2b8bcabc admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:54.326759 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-9ffaa690-1cf3-47b7-8cec-2f2f2b8bcabc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 02 08:58:54.326759 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:54.703539 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-fb4823e8-921e-4ded-b68f-52f8037b46c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "id": "3"}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:54.800499 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-fb4823e8-921e-4ded-b68f-52f8037b46c7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.506264 Aug 02 08:58:54.800964 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:58:54.813486 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a2564e7f-7dee-41eb-a8f4-d5173c07bc60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:54.918886 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a2564e7f-7dee-41eb-a8f4-d5173c07bc60 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109038 Aug 02 08:58:54.933673 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Aug 2 08:58:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:58:57.305678 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-fb4823e8-921e-4ded-b68f-52f8037b46c7 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:58:57.307473 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-fb4823e8-921e-4ded-b68f-52f8037b46c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002349 Aug 02 08:58:57.307952 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:58:57.893623 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-9fb40ede-59b2-48fc-ac4a-6119e65d2fe2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:57.900418 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:58:57.986589 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-9fb40ede-59b2-48fc-ac4a-6119e65d2fe2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.672018 Aug 02 08:58:57.987222 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:58:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 08:58:58.001125 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-6a4c2f67-0846-412a-94d0-ee8f3dda015b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:58:58.113233 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-6a4c2f67-0846-412a-94d0-ee8f3dda015b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116773 Aug 02 08:58:58.113761 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Aug 2 08:58:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:00.526691 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-9fb40ede-59b2-48fc-ac4a-6119e65d2fe2 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:00.528414 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-9fb40ede-59b2-48fc-ac4a-6119e65d2fe2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Aug 02 08:59:00.529475 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:01.157307 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-b0824404-4dac-4e03-a132-3ccd02c29066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "swap": 0, "vcpus": 8}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:01.326845 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-b0824404-4dac-4e03-a132-3ccd02c29066 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.790409 Aug 02 08:59:01.335215 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Aug 2 08:59:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:59:01.340927 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-08256cc4-8403-4726-855b-9d9b9022ca9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:01.452254 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-08256cc4-8403-4726-855b-9d9b9022ca9e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114192 Aug 02 08:59:01.453342 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Aug 2 08:59:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:59:22.976276 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-b0824404-4dac-4e03-a132-3ccd02c29066 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:22.978200 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-b0824404-4dac-4e03-a132-3ccd02c29066 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002141 Aug 02 08:59:22.978847 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 08:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:59:23.499803 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-1b963ea1-0229-401d-a811-b39e807fe01a admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:23.519491 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-1b963ea1-0229-401d-a811-b39e807fe01a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.532748 Aug 02 08:59:23.520040 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Aug 2 08:59:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:24.745296 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-b0824404-4dac-4e03-a132-3ccd02c29066 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:24.746682 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-b0824404-4dac-4e03-a132-3ccd02c29066 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Aug 02 08:59:24.747283 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 08:59:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:59:25.386090 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-70c71933-d6c3-4451-a216-bcf29debc381 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:25.392175 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.wsgi [None req-70c71933-d6c3-4451-a216-bcf29debc381 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-70c71933-d6c3-4451-a216-bcf29debc381 admin admin] Request method failure captured: Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Accept: application/json Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Accept-Encoding: gzip, deflate Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Connection: keep-alive Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Content-Length: 0 Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Host: 10.222.0.46 Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Openstack-Api-Version: compute 2.90 Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Openstack-System-Scope: None Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: User-Agent: python-novaclient Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Auth-Token: gAAAAABi6OdsUlzhnGW_9au76f4meDYliPOk6Wu9apcvGlE49Zjmhy1wtQH1Lx8pc-swDHanFOINK7RrQthJvEa9MAivVuS-C2AKs1nK_MAY-qXGSTCSEG6gOGqqPqCHG5tdmkC5HKHcZAGdXZX_qewKYT5ZEGTMRGZfplmWtMEuF-n8CHlBEmU Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Domain-Id: None Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Domain-Name: None Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Identity-Status: Confirmed Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Is-Admin-Project: True Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Domain-Id: default Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Domain-Name: Default Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Name: admin Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Role: admin,member,reader Aug 02 08:59:25.395517 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Roles: admin,member,reader Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant: admin Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant-Name: admin Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User: admin Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Domain-Id: default Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Domain-Name: Default Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Id: 5b34698a764b44aba3d550dca381a370 Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Name: admin Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: method: > Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: exception: Flavor 42 could not be found. Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: action_args: {'id': '42'} Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:59:25.397736 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:25.399503 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.403546 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-70c71933-d6c3-4451-a216-bcf29debc381 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:59:25.406082 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-70c71933-d6c3-4451-a216-bcf29debc381 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.502981 Aug 02 08:59:25.406082 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Aug 2 08:59:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 504 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 08:59:25.408468 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-b8d8e6d9-8d54-4532-9017-93ca41bd590c admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:25.416238 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:59:25.438250 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-b8d8e6d9-8d54-4532-9017-93ca41bd590c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033499 Aug 02 08:59:25.438844 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 2 08:59:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:59:25.450177 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-45f0be98-84da-4077-a766-727ca91150a1 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:25.476434 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-45f0be98-84da-4077-a766-727ca91150a1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030609 Aug 02 08:59:25.477021 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 2 08:59:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:25.488484 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-e3503e13-98c2-4e51-a933-e91385957a48 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:25.495882 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.wsgi [None req-e3503e13-98c2-4e51-a933-e91385957a48 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-e3503e13-98c2-4e51-a933-e91385957a48 admin admin] Request method failure captured: Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Accept: application/json Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Accept-Encoding: gzip, deflate Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Connection: keep-alive Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Content-Length: 0 Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Host: 10.222.0.46 Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Openstack-Api-Version: compute 2.90 Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Openstack-System-Scope: None Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: User-Agent: python-novaclient Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Auth-Token: gAAAAABi6OdsUlzhnGW_9au76f4meDYliPOk6Wu9apcvGlE49Zjmhy1wtQH1Lx8pc-swDHanFOINK7RrQthJvEa9MAivVuS-C2AKs1nK_MAY-qXGSTCSEG6gOGqqPqCHG5tdmkC5HKHcZAGdXZX_qewKYT5ZEGTMRGZfplmWtMEuF-n8CHlBEmU Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Domain-Id: None Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Domain-Name: None Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Identity-Status: Confirmed Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Is-Admin-Project: True Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Domain-Id: default Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Domain-Name: Default Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Name: admin Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Role: admin,member,reader Aug 02 08:59:25.499394 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Roles: admin,member,reader Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant: admin Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant-Name: admin Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User: admin Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Domain-Id: default Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Domain-Name: Default Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Id: 5b34698a764b44aba3d550dca381a370 Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Name: admin Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: method: > Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: exception: Flavor 42 could not be found. Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: action_args: {'id': '42'} Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:59:25.505622 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:25.506491 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:25.507585 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-e3503e13-98c2-4e51-a933-e91385957a48 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:59:25.509298 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-e3503e13-98c2-4e51-a933-e91385957a48 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017271 Aug 02 08:59:25.509298 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Aug 2 08:59:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:26.643610 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-45f0be98-84da-4077-a766-727ca91150a1 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:26.645402 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-45f0be98-84da-4077-a766-727ca91150a1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002442 Aug 02 08:59:26.646108 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 08:59:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:59:27.325183 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-fb93fd36-e39b-4e3b-acf5-03f4f586d2bf admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:27.335559 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.wsgi [None req-fb93fd36-e39b-4e3b-acf5-03f4f586d2bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-fb93fd36-e39b-4e3b-acf5-03f4f586d2bf admin admin] Request method failure captured: Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Accept: application/json Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Accept-Encoding: gzip, deflate Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Connection: keep-alive Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Content-Length: 0 Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Host: 10.222.0.46 Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Openstack-Api-Version: compute 2.90 Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Openstack-System-Scope: None Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: User-Agent: python-novaclient Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Auth-Token: gAAAAABi6OdusRL2CzQYwBeZOIF0dCKeiGNCRKn1i9CVHTFh2Tz1f5kUlxUWMuN_abUQrA64-ryKL69p5PJ35lsYn4gGvQBN4KG51_TZR0spJhFQ-nUWLBzNL-CIZa_T3bHbEFhOFC76Luy_nEfwhucDSfc05H2wKwcrbuOznu15aLRbpLrW7uk Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Domain-Id: None Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Domain-Name: None Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Identity-Status: Confirmed Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Is-Admin-Project: True Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Domain-Id: default Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Domain-Name: Default Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Name: admin Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Role: admin,member,reader Aug 02 08:59:27.338811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Roles: admin,member,reader Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant: admin Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant-Name: admin Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User: admin Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Domain-Id: default Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Domain-Name: Default Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Id: 5b34698a764b44aba3d550dca381a370 Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Name: admin Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: method: > Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: exception: Flavor 84 could not be found. Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: action_args: {'id': '84'} Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:59:27.341337 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:27.342893 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.344853 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-fb93fd36-e39b-4e3b-acf5-03f4f586d2bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:59:27.347013 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-fb93fd36-e39b-4e3b-acf5-03f4f586d2bf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.547504 Aug 02 08:59:27.347013 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Aug 2 08:59:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 549 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 08:59:27.356972 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-0ab42e19-40cc-47f2-a731-14eb4e9e6b6d admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:27.373952 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-0ab42e19-40cc-47f2-a731-14eb4e9e6b6d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022844 Aug 02 08:59:27.374540 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 2 08:59:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 08:59:27.387722 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-b2667374-6c21-4f9a-bc95-698cf75980f7 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:27.415488 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-b2667374-6c21-4f9a-bc95-698cf75980f7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031785 Aug 02 08:59:27.416127 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 2 08:59:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:59:27.426250 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-5faa2732-0a92-4407-a127-6b938a8bfb95 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:27.432009 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.wsgi [None req-5faa2732-0a92-4407-a127-6b938a8bfb95 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-5faa2732-0a92-4407-a127-6b938a8bfb95 admin admin] Request method failure captured: Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Accept: application/json Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Accept-Encoding: gzip, deflate Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Connection: keep-alive Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Content-Length: 0 Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Host: 10.222.0.46 Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Openstack-Api-Version: compute 2.90 Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Openstack-System-Scope: None Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: User-Agent: python-novaclient Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Auth-Token: gAAAAABi6OdusRL2CzQYwBeZOIF0dCKeiGNCRKn1i9CVHTFh2Tz1f5kUlxUWMuN_abUQrA64-ryKL69p5PJ35lsYn4gGvQBN4KG51_TZR0spJhFQ-nUWLBzNL-CIZa_T3bHbEFhOFC76Luy_nEfwhucDSfc05H2wKwcrbuOznu15aLRbpLrW7uk Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Domain-Id: None Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Domain-Name: None Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Identity-Status: Confirmed Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Is-Admin-Project: True Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Domain-Id: default Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Domain-Name: Default Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Name: admin Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Role: admin,member,reader Aug 02 08:59:27.433570 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Roles: admin,member,reader Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant: admin Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant-Name: admin Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User: admin Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Domain-Id: default Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Domain-Name: Default Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Id: 5b34698a764b44aba3d550dca381a370 Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Name: admin Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: method: > Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: exception: Flavor 84 could not be found. Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: action_args: {'id': '84'} Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:59:27.435488 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:27.436827 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:27.438985 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-5faa2732-0a92-4407-a127-6b938a8bfb95 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:59:27.440689 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-5faa2732-0a92-4407-a127-6b938a8bfb95 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012446 Aug 02 08:59:27.440689 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Aug 2 08:59:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 08:59:28.514079 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-b2667374-6c21-4f9a-bc95-698cf75980f7 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:28.515111 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-b2667374-6c21-4f9a-bc95-698cf75980f7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001813 Aug 02 08:59:28.515503 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 08:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:29.149656 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-cab29437-7f94-453d-a22a-f100943c64f5 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:29.155805 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.wsgi [None req-cab29437-7f94-453d-a22a-f100943c64f5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-cab29437-7f94-453d-a22a-f100943c64f5 admin admin] Request method failure captured: Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Accept: application/json Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Accept-Encoding: gzip, deflate Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Connection: keep-alive Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Content-Length: 0 Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Host: 10.222.0.46 Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Openstack-Api-Version: compute 2.90 Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Openstack-System-Scope: None Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: User-Agent: python-novaclient Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Auth-Token: gAAAAABi6OdwSPFFYG2ES0gyU1DeRzvxvjSV5v6Lzdlan6wNsmUC37LOv-nPJoyLYTlcvBLcwjMXlzQ9fKLj0OULv8cRPK152bkzTcbjVr9ElpOJAEiadM32gNNzjUgk9LSTXA3wvW0vbhYEXu8eAuRFIkZbt4NcNyUJJUl2o-95x8SDmWx20M8 Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Domain-Id: None Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Domain-Name: None Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Identity-Status: Confirmed Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Is-Admin-Project: True Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Domain-Id: default Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Domain-Name: Default Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Project-Name: admin Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Role: admin,member,reader Aug 02 08:59:29.157244 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Roles: admin,member,reader Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant: admin Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-Tenant-Name: admin Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User: admin Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Domain-Id: default Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Domain-Name: Default Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Id: 5b34698a764b44aba3d550dca381a370 Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: X-User-Name: admin Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: method: > Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: exception: Flavor 451 could not be found. Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: action_args: {'id': '451'} Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:59:29.158833 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:29.159855 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.160971 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-cab29437-7f94-453d-a22a-f100943c64f5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:59:29.162163 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-cab29437-7f94-453d-a22a-f100943c64f5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.497542 Aug 02 08:59:29.162163 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 2 08:59:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 499 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 08:59:29.171924 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-5c489db2-4fe1-441a-a60c-2715e8aa82a9 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:29.188100 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-5c489db2-4fe1-441a-a60c-2715e8aa82a9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019864 Aug 02 08:59:29.188651 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 2 08:59:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:59:29.200698 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:29.216323 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021028 Aug 02 08:59:29.216862 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 2 08:59:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 08:59:29.226732 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-bc38370d-dff5-455f-8133-4c8328f3bfb7 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:29.232432 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.wsgi [None req-bc38370d-dff5-455f-8133-4c8328f3bfb7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-bc38370d-dff5-455f-8133-4c8328f3bfb7 admin admin] Request method failure captured: Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Accept: application/json Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Accept-Encoding: gzip, deflate Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Connection: keep-alive Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Content-Length: 0 Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Host: 10.222.0.46 Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Openstack-Api-Version: compute 2.90 Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Openstack-System-Scope: None Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: User-Agent: python-novaclient Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Auth-Token: gAAAAABi6OdwSPFFYG2ES0gyU1DeRzvxvjSV5v6Lzdlan6wNsmUC37LOv-nPJoyLYTlcvBLcwjMXlzQ9fKLj0OULv8cRPK152bkzTcbjVr9ElpOJAEiadM32gNNzjUgk9LSTXA3wvW0vbhYEXu8eAuRFIkZbt4NcNyUJJUl2o-95x8SDmWx20M8 Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Domain-Id: None Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Domain-Name: None Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Identity-Status: Confirmed Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Is-Admin-Project: True Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Domain-Id: default Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Domain-Name: Default Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Project-Name: admin Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Role: admin,member,reader Aug 02 08:59:29.233987 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Roles: admin,member,reader Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a92b68d350c4f7998c221772fb56b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant: admin Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant-Id: 2a92b68d350c4f7998c221772fb56b4a Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-Tenant-Name: admin Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User: admin Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Domain-Id: default Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Domain-Name: Default Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Id: 5b34698a764b44aba3d550dca381a370 Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: X-User-Name: admin Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: method: > Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: exception: Flavor 451 could not be found. Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: action_args: {'id': '451'} Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:59:29.236523 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:29.238124 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: ERROR nova.api.openstack.wsgi Aug 02 08:59:29.240099 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-bc38370d-dff5-455f-8133-4c8328f3bfb7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:59:29.242076 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-bc38370d-dff5-455f-8133-4c8328f3bfb7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012372 Aug 02 08:59:29.242076 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 2 08:59:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 08:59:30.327523 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:30.328528 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 02 08:59:30.328922 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 08:59:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:30.946518 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-efae9d5d-1fb9-4faa-8953-a8ff8aabc299 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:31.051988 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-efae9d5d-1fb9-4faa-8953-a8ff8aabc299 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.581344 Aug 02 08:59:31.052434 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Aug 2 08:59:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 08:59:32.090725 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:32.091817 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 02 08:59:32.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 08:59:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:32.721274 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-44c55998-267c-484f-9e45-755213e31786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:32.826003 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-44c55998-267c-484f-9e45-755213e31786 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.579806 Aug 02 08:59:32.826821 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Aug 2 08:59:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 08:59:33.896502 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:33.897496 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 02 08:59:33.897938 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 08:59:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:34.519905 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-a02d6dcc-770c-4575-9fa5-8bb2e7c82230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:34.597143 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-a02d6dcc-770c-4575-9fa5-8bb2e7c82230 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.551324 Aug 02 08:59:34.597699 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Aug 2 08:59:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:59:35.621011 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:35.622137 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 02 08:59:35.622602 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 08:59:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:36.257618 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-c718f466-9184-4537-bcd8-14b061909d3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:59:36.343577 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-c718f466-9184-4537-bcd8-14b061909d3a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.579076 Aug 02 08:59:36.344057 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Aug 2 08:59:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:59:37.403904 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:37.405261 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Aug 02 08:59:37.405840 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 08:59:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:59:38.053729 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-8afc36b6-f861-41d6-a801-30dd7abb7c05 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:59:38.083441 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-8afc36b6-f861-41d6-a801-30dd7abb7c05 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.533305 Aug 02 08:59:38.083981 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Tue Aug 2 08:59:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:32.677100 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:32.678153 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-a109cfc9-883a-40f3-8294-6b0c20c00c29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 02 09:00:32.678565 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Tue Aug 2 09:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:00:32.689985 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:33.111805 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-0588dea1-6e44-4741-a659-279d10cee241 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:33.134524 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-0588dea1-6e44-4741-a659-279d10cee241 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.449075 Aug 02 09:00:33.135202 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Aug 2 09:00:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:00:33.156579 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG dbcounter [-] [103827] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:00:33.161016 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-02128ae2-0132-4347-b081-556970123631 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:33.168975 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-02128ae2-0132-4347-b081-556970123631 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014379 Aug 02 09:00:33.169900 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Tue Aug 2 09:00:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:33.182334 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-35fe37ca-4ad6-4620-b459-61053c2a27fd admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:33.190212 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-35fe37ca-4ad6-4620-b459-61053c2a27fd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012090 Aug 02 09:00:33.190753 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Tue Aug 2 09:00:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:33.204031 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:33.212420 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012577 Aug 02 09:00:33.212982 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Tue Aug 2 09:00:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:00:33.227514 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-1b142e95-7079-44e2-8972-7d929e655c3e admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:33.235647 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-1b142e95-7079-44e2-8972-7d929e655c3e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012158 Aug 02 09:00:33.236130 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Tue Aug 2 09:00:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:10.069601 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:10.070635 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 02 09:04:10.071019 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 09:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:10.213050 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_api:SELECT=6 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.366239 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-e1f2d2d1-545a-4104-b6ec-023c4e57f7af admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:10.378526 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:04:10.378526 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: warnings.warn(msg) Aug 02 09:04:10.378526 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-e1f2d2d1-545a-4104-b6ec-023c4e57f7af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:10.378526 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-e1f2d2d1-545a-4104-b6ec-023c4e57f7af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:10.378526 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-e1f2d2d1-545a-4104-b6ec-023c4e57f7af admin admin] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:10.378526 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-e1f2d2d1-545a-4104-b6ec-023c4e57f7af admin admin] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:10.406238 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-e1f2d2d1-545a-4104-b6ec-023c4e57f7af admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.194889 Aug 02 09:04:10.407080 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 2 09:04:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:11.239441 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:11.240493 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 02 09:04:11.240927 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 09:04:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:11.435030 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-09e2a301-9c9e-44c8-9e82-41ed88a4420e admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:11.437470 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:04:11.437470 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: warnings.warn(msg) Aug 02 09:04:11.438703 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-09e2a301-9c9e-44c8-9e82-41ed88a4420e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:11.439152 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-09e2a301-9c9e-44c8-9e82-41ed88a4420e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:11.439942 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-09e2a301-9c9e-44c8-9e82-41ed88a4420e admin admin] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:11.440377 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-09e2a301-9c9e-44c8-9e82-41ed88a4420e admin admin] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:11.460486 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-09e2a301-9c9e-44c8-9e82-41ed88a4420e admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077246 Aug 02 09:04:11.460975 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 2 09:04:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:22.732495 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:22.733562 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 02 09:04:22.733974 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 09:04:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:22.877023 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_cell0:SELECT=4 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:22.877818 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_cell1:SELECT=4 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:22.878916 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG dbcounter [-] [103828] Writing DB stats nova_api:SELECT=8 {{(pid=103828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:22.937527 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-be0d12c8-b557-456f-81aa-4e5baf518ee6 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:22.940128 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:04:22.940128 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: warnings.warn(msg) Aug 02 09:04:22.941365 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-be0d12c8-b557-456f-81aa-4e5baf518ee6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:22.941857 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-be0d12c8-b557-456f-81aa-4e5baf518ee6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:22.949263 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-be0d12c8-b557-456f-81aa-4e5baf518ee6 admin admin] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:22.949263 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-be0d12c8-b557-456f-81aa-4e5baf518ee6 admin admin] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:22.969168 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-be0d12c8-b557-456f-81aa-4e5baf518ee6 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.096631 Aug 02 09:04:22.969742 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 2 09:04:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:23.814982 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: DEBUG nova.api.openstack.wsgi [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] Calling method '>' {{(pid=103827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:23.816098 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: INFO nova.api.openstack.requestlog [None req-daf7a2b7-3907-4153-9d02-047e35ea1329 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 02 09:04:23.817674 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: [pid: 103827|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 2 09:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:24.016555 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG nova.api.openstack.wsgi [None req-27ed2b60-7efe-4884-b169-2c20f7e04977 admin admin] Calling method '>' {{(pid=103828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:24.019126 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:04:24.019126 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: warnings.warn(msg) Aug 02 09:04:24.020482 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-27ed2b60-7efe-4884-b169-2c20f7e04977 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:24.021019 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-27ed2b60-7efe-4884-b169-2c20f7e04977 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:24.021811 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-27ed2b60-7efe-4884-b169-2c20f7e04977 admin admin] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:04:24.022260 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: DEBUG oslo_concurrency.lockutils [None req-27ed2b60-7efe-4884-b169-2c20f7e04977 admin admin] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:04:24.045137 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: INFO nova.api.openstack.requestlog [None req-27ed2b60-7efe-4884-b169-2c20f7e04977 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087202 Aug 02 09:04:24.045719 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: [pid: 103828|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 2 09:04:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:05:23.566769 dv-cinder-847131-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 09:05:23.567673 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: Tue Aug 2 09:05:23 2022 - graceful shutdown triggered... Aug 02 09:05:23.568223 dv-cinder-847131-4-iscsi devstack@n-api.service[103828]: Gracefully killing worker 2 (pid: 103828)... Aug 02 09:05:23.568624 dv-cinder-847131-4-iscsi devstack@n-api.service[103827]: Gracefully killing worker 1 (pid: 103827)... Aug 02 09:05:24.568697 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: worker 1 buried after 1 seconds Aug 02 09:05:24.568697 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: worker 2 buried after 1 seconds Aug 02 09:05:24.568697 dv-cinder-847131-4-iscsi devstack@n-api.service[103826]: goodbye to uWSGI. Aug 02 09:05:24.570437 dv-cinder-847131-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 02 09:05:24.571118 dv-cinder-847131-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 09:05:24.573939 dv-cinder-847131-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 09:05:24.584466 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 09:05:24 2022] *** Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: nodename: dv-cinder-847131-4-iscsi Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: machine: x86_64 Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: clock source: unix Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: pcre jit disabled Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: detected number of CPU cores: 4 Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: current working directory: / Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: detected binary path: /usr/bin/uwsgi-core Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: your processes number limit is 47680 Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: your memory page size is 4096 bytes Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: detected max file descriptor number: 2048 Aug 02 09:05:24.586445 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: lock engine: pthread robust mutexes Aug 02 09:05:24.587503 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: thunder lock: enabled Aug 02 09:05:24.587503 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 09:05:24.587503 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 09:05:24.627644 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: Python main interpreter initialized at 0x563f736bd9c0 Aug 02 09:05:24.627644 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: python threads support enabled Aug 02 09:05:24.627644 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: your server socket listen backlog is limited to 100 connections Aug 02 09:05:24.627644 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: your mercy for graceful operations on workers is 90 seconds Aug 02 09:05:24.628126 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 09:05:24.628126 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: *** Operational MODE: preforking *** Aug 02 09:05:24.628365 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: *** uWSGI is running in multiple interpreter mode *** Aug 02 09:05:24.628365 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: spawned uWSGI master process (pid: 118347) Aug 02 09:05:24.628577 dv-cinder-847131-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 09:05:24.629160 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: spawned uWSGI worker 1 (pid: 118366, cores: 1) Aug 02 09:05:24.629523 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: spawned uWSGI worker 2 (pid: 118368, cores: 1) Aug 02 09:05:24.629755 dv-cinder-847131-4-iscsi devstack@n-api.service[118347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 09:05:25.302610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:05:25.326665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:05:26.477339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:05:26.477339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: from cryptography.utils import int_from_bytes Aug 02 09:05:26.478232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:05:26.478232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: from cryptography.utils import int_from_bytes Aug 02 09:05:26.506387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:05:26.506387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: from cryptography.utils import int_from_bytes Aug 02 09:05:26.507045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:05:26.507045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: from cryptography.utils import int_from_bytes Aug 02 09:05:28.946725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:05:28.947554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:05:28.948291 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:05:28.948831 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:05:28.949263 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:05:28.949835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.950964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.951502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.952018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.952580 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.952906 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.953243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.953577 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.954247 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.954534 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.954847 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.955180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-4-iscsi {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.955509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.956000 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.956322 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.956653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.956964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.957295 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.957625 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.958178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-4-iscsi {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.967752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.968787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.969181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.969181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.970040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.970465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.970869 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.971185 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:05:28.971613 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.971613 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.971755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:05:28.971842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.971998 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:05:28.972218 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.972567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:05:28.972770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.972908 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:05:28.973070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.973202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.973536 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.973700 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.973870 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.974073 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.974227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.974369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.974538 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.974765 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.974940 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.975083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.975237 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.975385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.975531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.975689 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.975845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.975994 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.976144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.976287 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.976427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.976619 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.976778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-4-iscsi {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.976934 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.977093 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.977244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.977393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.977584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.977737 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.977926 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.978086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.978235 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.978384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.978524 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.978706 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.978862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.979011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.979456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.979626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.979794 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.979960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.980134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.980302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.980463 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.980615 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.980763 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.980916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.981066 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.981522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.981713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.981936 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.982090 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.982248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.982406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.982555 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.982873 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.983029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.983208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.983460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.983706 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.983706 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.983989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-4-iscsi {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.984144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.984287 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.984426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.984572 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.984729 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.984871 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.985019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.985159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.985307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.985447 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.985593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.985741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.985908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.986056 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.986207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.986356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.986514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.986654 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.987083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.987237 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.987387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.987529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.987690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.987917 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.988069 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.988218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.988366 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.988507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.988656 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.988816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.988957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.989104 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.989250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.989755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.989957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.990115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.990256 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.990396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.990396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.990685 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.990825 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.991013 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.991172 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.991336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.991336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.991952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.992101 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.992242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.992242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.992521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.992671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.992971 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.993123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.993276 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.993444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.994465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.994633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.994779 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.994956 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.995112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.995264 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.995413 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.995554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.995703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.995844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.995992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.996166 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.996308 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.996455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.996596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.996748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.996890 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.997549 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:28.997712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.000269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.001042 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.001208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.001380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.001380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.002059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.002223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.002375 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.002525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.002665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.002817 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.003144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.003305 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.003447 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.003587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.003734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.003734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.004027 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.004214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.004373 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.004710 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.004829 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.004947 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.005071 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.005184 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.005301 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.005411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.005521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.005641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.005641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.005858 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.005858 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.013797 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.014170 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.014278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.014278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.014468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.014552 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.014632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.014716 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.014811 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.014906 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.014992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.015075 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.015158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.015241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.015338 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.015430 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.015514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.015603 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.015694 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.015777 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.015878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.015963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.016051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.016141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.016232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.016316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.016316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.016488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.016582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.016674 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.016759 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.016847 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.016942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.017030 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.017111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.017200 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.017283 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.017379 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.017470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.017553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.017635 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.017724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.017816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.017942 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.018030 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.018030 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.018207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.018207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.018358 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.018358 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.018522 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.018610 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.018706 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.018804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.018888 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.018976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.019065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.019153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.019244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.019334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.019424 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.019517 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.019594 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.019672 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.019672 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.019817 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.019889 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.019959 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.020028 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.020120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.020194 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.020277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.020362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.020451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.020560 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.020703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.020878 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.020974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.021054 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.021138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.021230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.021230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.021447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.021550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.021644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.021728 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.021818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.021929 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.022026 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.022106 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.022190 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.022280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.022366 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.022449 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.022587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.022674 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.022764 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.022848 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.022929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:05:29.023104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023287 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023371 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023653 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.023926 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024010 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024107 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024282 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024445 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024552 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024831 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.024924 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025013 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025100 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025452 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025711 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025794 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025896 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.025983 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026067 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026169 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026444 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026617 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026709 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026800 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026890 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.026985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027076 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027172 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027256 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027345 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027610 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027701 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.027874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.028039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.028136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.028233 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.028409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.028502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.028581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029233 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029314 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029395 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029696 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029778 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.029850 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030027 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030113 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030209 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030533 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030684 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030756 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030825 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.030904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031173 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031620 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031857 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.031928 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.033094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.033250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.033250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.033488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.033623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.033764 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.033764 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.034096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.034096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.034096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.034446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.034540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.034625 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.035297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.035455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.035455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.035702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.035805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.035931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.036183 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.036293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.036501 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.036651 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.036819 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.036927 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.037144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.037248 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.037451 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.037555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.037763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.037865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.038106 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.038229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.038425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.038528 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.038737 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.038840 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.039066 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.039165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.039386 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.039489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.039699 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.039793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.040028 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.040130 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.040337 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.040431 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.040650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.040757 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.040973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.041073 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.041290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.041391 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.041607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.041714 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.041946 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.042098 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.042267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.042442 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.042597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.042756 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.042916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.043070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.043234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.043631 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.043739 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.043961 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.044092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.044269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.044372 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.044600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.044703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.044931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.045023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.045253 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.045429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.045555 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.045872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.047781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048229 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048324 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048692 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048777 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048869 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.048969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049055 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049237 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049405 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049503 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049765 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.049993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050155 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050239 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050592 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050683 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.050918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.051129 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.051236 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.051445 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.051538 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.051806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.051907 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.052126 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.052220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.052431 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.052520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.052742 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.052835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.053058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.053159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.053379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.053532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.053748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.053985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.054098 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.054262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.054366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.054571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.054664 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.054876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.054978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.055201 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.055295 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.055542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.055656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.055885 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.055999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.056210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.056305 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.056520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.056614 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.056841 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.056940 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.057186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.057286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.057491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.057583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.057813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.057944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.058167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.058266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.058485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.058577 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.058806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.058899 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.059130 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.059230 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.059439 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.060143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.060305 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.060452 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.060597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.060742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.060892 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.061047 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.061188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.061339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.061481 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.061628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.061792 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.061951 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.062165 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.062316 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.062538 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.062651 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.062806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.062911 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.063115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.063209 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.063434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.063537 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.063785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.063980 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.064171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.064300 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.064518 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.064629 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.064835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.065163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.065254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.065479 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.065593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.065795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.065943 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.066199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.066375 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.066514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.066751 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.067067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.067388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.067703 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.067840 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.068019 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.068164 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.068326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.068479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.068621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.068771 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.068922 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.069064 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.069217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.069368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.069511 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.069667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.069810 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.070001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.070163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.070312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.070493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.070626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.070806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.070935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.071132 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.071245 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.071441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.071611 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.071752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.071845 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.072080 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.072220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.072394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.072500 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.072773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.072892 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.073011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.073112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.073322 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.073429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.073637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.073744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.077940 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.078560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.078928 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079129 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079216 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079549 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079635 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.079906 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080000 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080175 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080733 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.080899 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081062 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081157 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081237 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081309 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081564 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081656 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081839 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.081973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.087909 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088403 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088668 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.088918 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089197 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089287 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089378 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089462 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089663 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089746 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089836 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.089944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090132 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090322 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090663 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.090928 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091020 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091203 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091391 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091754 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.091920 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092096 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092197 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092365 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092545 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092638 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.092997 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093620 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.093804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094015 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094193 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094518 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094588 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094819 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.094965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095043 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095461 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095552 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095767 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.095950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096044 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096138 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096230 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096310 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096403 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096660 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.096919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.097010 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.097098 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.097195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.097281 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.097607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.097710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.097830 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.097957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098310 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098678 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.098944 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.099126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.099283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.099445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.099602 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.099761 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.099909 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.100072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.100226 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.100389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.100536 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.100700 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.100849 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.101020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.101152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.101329 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.101457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.101638 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.101777 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.101972 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.102112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.102290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.102422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.102604 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.102741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.102914 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.103063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.103244 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.103386 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.103560 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.103691 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.103869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.103999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.104210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.104435 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.104548 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.104883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.105038 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.105275 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.105374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.105488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.105593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.105690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.105776 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.105996 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.106096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.106311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.106457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.106659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.106764 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.106966 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.107061 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.107271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.107373 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.107659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.107767 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.107890 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.107983 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.108197 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.108311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.108509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.108619 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.108819 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.108913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.109121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.109228 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.109426 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.109537 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.109729 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.109821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.110064 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.110768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111003 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111435 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111435 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111705 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.111882 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.112026 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.112139 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.112317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.112417 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.112653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.112752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.112939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.113043 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.113242 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.113345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.113600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.113698 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.113944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.114044 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.114262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.114449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.114628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.114772 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.114958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.115119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.115281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.115440 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.115611 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.115707 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.115900 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.116052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.116196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.116338 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.116501 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.116656 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.116755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.116888 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.117005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.117210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.117332 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.117542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.117794 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.118023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.118164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.118319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.118471 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.118630 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.118781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.118923 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.119074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.119216 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.119358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.119515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.119676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.119830 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.119969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.120107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.120254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.120397 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.120541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.120688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.120827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.120977 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.121129 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.121271 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.121422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.121573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.121734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.121869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.122576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.122744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.122906 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.123079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.123219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.123401 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.123545 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.123714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.123820 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.124031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.124152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.124486 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.124594 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.124679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.124782 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.124944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.125081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.125383 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.125486 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.125726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.125830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.126041 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.126168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.126353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.126460 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.126674 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.126769 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.127050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.127180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.127353 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.127511 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.127660 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.127838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.128037 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.128151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.128241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.128441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.128536 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.128761 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.128911 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.129079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.129182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.129397 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.129580 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.129736 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.129925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.130216 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.130443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.130443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.130733 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.130886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.131039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.131190 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.131334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.131476 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.131619 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.131770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.131913 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.132075 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.132213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.132367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.132517 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.132672 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.132815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.132981 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.133122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.133265 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.133413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.133662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.133842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.133973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.133973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.134137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.134296 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.134394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.134667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.134788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.134920 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.135016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.135252 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.135354 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.135579 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.135674 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.135928 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.136037 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.136213 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.136310 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.136528 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.136629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.136843 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.136951 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.137160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.137262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.137484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.137584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.138465 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.138738 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.138836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.139053 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.139146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.139371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.139474 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.139680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.139783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.139990 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.140091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.140295 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.140422 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.140610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.140751 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.140914 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.141069 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.141220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.141400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.141525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.141734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.141849 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.142074 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.142179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.142388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.142490 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.142708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.142802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.143020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.143120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.143334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.143427 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.143658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.143797 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.143967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.144073 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.144282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.144387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.144612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.144725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.144963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.145141 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.145296 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.145440 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.145583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.145735 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.145906 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.146197 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.146416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.146569 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.146720 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.146862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.147004 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.147159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.147159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.147444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.147593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.147741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.147889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.148041 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.148189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.148331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.148476 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.148659 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.148818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.148963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.149107 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.149268 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.149365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.149459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.149555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.149641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.149838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.150052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.150192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.150382 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.150529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.150705 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.150864 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.151018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.151183 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.151331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.151548 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.151678 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.151858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.151965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.152179 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.152287 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.152504 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.152605 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.152835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.152935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.153143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.153251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.153502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.153604 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.153827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.153976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.154164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.154288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.154474 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.154578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.154786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.154886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.155104 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.155213 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.155411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.155504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.155721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.155816 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.156031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.156142 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.156367 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.156473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.156671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.156762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.156985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.157079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.157298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.157391 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.157606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.157707 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.157934 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.158031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.158376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.158581 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.158723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.158866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.159036 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.159154 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.159376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.159470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.159699 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.159805 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.160025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.160127 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.160361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.160456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.160678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.160773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.161007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.161108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.161328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.161428 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.161644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.161739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.161983 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.162092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.162431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.162676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.162829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.162969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.163116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.163269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.163526 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.163681 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.163838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.164026 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.164178 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.164348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.164511 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.164671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.164832 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.164977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.165133 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.165254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.165463 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.165573 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.165788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.165957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.166136 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.166229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.166458 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.166640 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.166783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.166886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.167105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.167199 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.167415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.167522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.167722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.167823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.168039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.168139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.168347 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.168492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.168679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.169433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.169599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.169903 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.170020 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.170247 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.170342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.170575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.170723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.170899 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.171007 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.171221 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.171317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.171544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.171637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.171872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.171967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.172183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.172277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.172492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.172594 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.172811 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.172906 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.173125 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.173230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.173433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.173533 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.173739 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.173841 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.174076 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.174184 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.174388 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.174491 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.174693 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.174795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.175004 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.175151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.175309 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.175455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.175667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.175799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.175975 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.176085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.176280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.176386 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.176587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.176709 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.176899 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.177003 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.177203 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.177298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.177506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.177600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.177812 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.177994 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.179532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.179532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.179788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.179893 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180030 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.180921 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181090 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181173 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181537 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181712 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.181803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.182042 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.182207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.182358 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.182532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.182693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.182846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.183015 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.183158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.183331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.183510 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.183660 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.183830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.183979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.184396 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.184570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.185468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.185797 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.186055 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.186151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.186393 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.186496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.186745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.186887 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.187084 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.187190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.187399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.187493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.187711 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.187815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.188022 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.188132 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.188344 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.188444 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.188660 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.188763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.188971 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.189063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.189283 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.189376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.189597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.189691 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.189940 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.190052 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.190260 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.190355 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.190575 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.190671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.190909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.191008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.191227 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.191356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.191540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.191672 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.191853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.191985 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.192164 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.192298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.192474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.192618 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.192819 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.192926 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.193106 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.193210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.193450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.193545 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.193772 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.193878 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.194112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.194219 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.194430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.194528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.194747 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.194850 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.195058 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.195162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.195369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.195480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.195682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.195796 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.195989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.196355 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.196485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.196693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.196818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.197024 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.197145 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.197316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.197428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.197627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.197729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.198089 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.198304 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.198396 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.198488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.198713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.198813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.199030 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.199135 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.199342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.199436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.199667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.199772 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.199994 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.200335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.200481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.200658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.200811 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.200964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.201117 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.201293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.201438 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.201650 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.201793 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.202010 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.202163 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.202326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.202476 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.202620 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.202770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.202871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.202965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.203171 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.203274 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.203479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.203573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.204048 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.204152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.204371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.204512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.204665 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.204761 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.204969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.205072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.205280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.205376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.205585 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.205708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.206051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.206154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.206241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.206326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.206501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.206612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.206812 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.206978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.207112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.207222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.207410 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.207546 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.207716 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.207821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.208018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.208128 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.208401 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.208646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.208764 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.208955 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.209058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.209268 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.209385 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.209576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.209679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.209908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.210047 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.210206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.210357 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.210543 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.210809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.210908 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.211128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.211223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.211487 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.211703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.211798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.212046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.212210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.212368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213256 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213351 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213536 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213631 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213716 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213812 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.213949 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.214096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.214247 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.214411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.214549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.214739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.215057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.215390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.215541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.215753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.216092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.216202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.216412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.216539 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.216732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.216844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.217041 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.217147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.217352 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.217479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.217662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.217756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.217999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.218110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.218314 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.218425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.218623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.218725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.218932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.219034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.219248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.219343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.219557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.219652 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.219869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.219962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.220179 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.220288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.220497 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.220606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.220846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.221116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.221229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.221318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.221443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.221618 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.221752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.222032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.222151 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.222350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.222445 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.222662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.222768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.222972 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.223081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.223280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.223381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.223589 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.223686 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.223904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.224006 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.224213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.224404 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.224525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.224612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.224835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.224983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.225140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.225291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.225468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.225621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.225807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.226008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.226186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.226331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.226487 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.226638 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.226791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.226933 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.227074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.227225 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.227368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.227532 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.227682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.227826 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.227974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:05:29.228125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.228323 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.228660 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.228976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.229290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.229607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.229944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.230265 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.230583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.230915 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.231244 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.232115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.232444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.232769 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.233093 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.233416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.233731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.234090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.234406 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.234723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.235038 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.235353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.235667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.235987 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.236299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.236612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.236963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.237293 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.237629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.237980 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.238299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.238628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.238958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.239316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.239637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.239988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.240321 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.240671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.240951 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.241262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:05:29.241511 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:05:29.292278 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO dbcounter [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Registered counter for database nova_api Aug 02 09:05:29.304287 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO dbcounter [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Registered counter for database nova_api Aug 02 09:05:29.314179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_db.sqlalchemy.engines [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:05:29.322038 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writer thread running {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:05:29.325773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_db.sqlalchemy.engines [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:05:29.332887 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writer thread running {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:05:29.379403 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.context [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5fe5474-0e15-44e4-8276-d3b5e9f77338(cell1) {{(pid=118368) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:05:29.383618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:29.385220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:29.386072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:29.388121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:29.390210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO dbcounter [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Registered counter for database nova_cell0 Aug 02 09:05:29.390476 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.context [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5fe5474-0e15-44e4-8276-d3b5e9f77338(cell1) {{(pid=118366) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:05:29.394401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO dbcounter [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Registered counter for database nova_cell1 Aug 02 09:05:29.394816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:29.396426 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:29.397244 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:05:29.399326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:05:29.401404 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO dbcounter [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Registered counter for database nova_cell0 Aug 02 09:05:29.401964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_db.sqlalchemy.engines [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:05:29.403216 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_db.sqlalchemy.engines [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:05:29.405796 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO dbcounter [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Registered counter for database nova_cell1 Aug 02 09:05:29.411032 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writer thread running {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:05:29.411376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writer thread running {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:05:29.414167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_db.sqlalchemy.engines [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:05:29.414912 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_db.sqlalchemy.engines [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:05:29.422640 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writer thread running {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:05:29.423958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writer thread running {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:05:29.563526 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO dbcounter [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Registered counter for database nova_cell0 Aug 02 09:05:29.570738 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_db.sqlalchemy.engines [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:05:29.574800 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO dbcounter [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Registered counter for database nova_cell0 Aug 02 09:05:29.575622 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writer thread running {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:05:29.585046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_db.sqlalchemy.engines [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:05:29.591899 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writer thread running {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:05:29.898598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: WARNING keystonemiddleware.auth_token [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:05:29.908337 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: WARNING keystonemiddleware.auth_token [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:05:29.919920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: WARNING keystonemiddleware.auth_token [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:05:29.927748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: WARNING keystonemiddleware.auth_token [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:05:30.267626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: WARNING keystonemiddleware.auth_token [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:05:30.273780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: WARNING keystonemiddleware.auth_token [None req-564566b8-8612-4fac-b833-3318e4e52218 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:05:30.279792 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f736bd9c0 pid: 118368 (default app) Aug 02 09:05:30.291721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: WARNING keystonemiddleware.auth_token [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:05:30.298369 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: WARNING keystonemiddleware.auth_token [None req-3646f814-0815-4bbb-a98e-18e14599eef6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:05:30.303703 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f736bd9c0 pid: 118366 (default app) Aug 02 09:06:13.966658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:13.968606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:13.969730 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:13.970618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:14.236202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:14.239018 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:14.240423 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:14.241753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:15.434103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5bcd844b-6f49-4655-b886-c0d86b069dc8 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Action: 'create', calling method: .version_select at 0x7f0f2f610f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-957782887"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:15.478091 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c08984df-189d-4b78-bb7f-fa3f735ffc8e tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Action: 'create', calling method: .version_select at 0x7f0f2f610ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-698374221", "metadata": {"Type": "work"}}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c08984df-189d-4b78-bb7f-fa3f735ffc8e tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Request method failure captured: Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 121 Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkFfhl1VvQTE8Ojyx-JxQYDns2a8lZvpMhe57imQSUVzeqAd7FwE2kIdK8oKwP8ysMglWvy2gdTeunaorE0-H84Y6rJv11y7w3Y11sGNWWnNmL19Kd9ZjLL39H95UekYvM7qS7uLbaUy0cr_yFDqHzribW0zJGBj9jycZALWWNVOe4 Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:15.503283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66edd4322b074654b865518b30a0a48e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66edd4322b074654b865518b30a0a48e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: a387e34d4254471cac5af552d2b8eb3f Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-698374221", "metadata": {"Type": "work"}}} Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:15.504658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-698374221', 'metadata': {'Type': 'work'}}}} Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:15.505511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:06:15.508050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:06:15.513370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:06:15.513370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.513370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c08984df-189d-4b78-bb7f-fa3f735ffc8e tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:15.513370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c08984df-189d-4b78-bb7f-fa3f735ffc8e tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.553662 Aug 02 09:06:15.513370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Tue Aug 2 09:06:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1559 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:06:15.517903 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0874111d-42ac-4790-8b5f-34b6003df5a5 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Action: 'create', calling method: .version_select at 0x7f0f2f51f9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1199402540", "metadata": {"Type": "work"}}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0874111d-42ac-4790-8b5f-34b6003df5a5 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Request method failure captured: Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 120 Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkFfhl1VvQTE8Ojyx-JxQYDns2a8lZvpMhe57imQSUVzeqAd7FwE2kIdK8oKwP8ysMglWvy2gdTeunaorE0-H84Y6rJv11y7w3Y11sGNWWnNmL19Kd9ZjLL39H95UekYvM7qS7uLbaUy0cr_yFDqHzribW0zJGBj9jycZALWWNVOe4 Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:15.521593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66edd4322b074654b865518b30a0a48e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66edd4322b074654b865518b30a0a48e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: a387e34d4254471cac5af552d2b8eb3f Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1199402540", "metadata": {"Type": "work"}}} Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:15.526732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1199402540', 'metadata': {'Type': 'work'}}}} Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi '0' Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:15.529676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:06:15.532936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:06:15.536533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:06:15.536533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.536533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0874111d-42ac-4790-8b5f-34b6003df5a5 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:15.536533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0874111d-42ac-4790-8b5f-34b6003df5a5 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021091 Aug 02 09:06:15.536533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 2/2] 10.222.0.46 () {60 vars in 1156 bytes} [Tue Aug 2 09:06:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:06:15.551341 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0e9bbc6d-a1b4-4d2d-82ac-0b5da71c0b14 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Action: 'create', calling method: .version_select at 0x7f0f2f4dfa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-704121256", "metadata": {"Type": "work"}}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0e9bbc6d-a1b4-4d2d-82ac-0b5da71c0b14 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Request method failure captured: Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 118 Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkFfhl1VvQTE8Ojyx-JxQYDns2a8lZvpMhe57imQSUVzeqAd7FwE2kIdK8oKwP8ysMglWvy2gdTeunaorE0-H84Y6rJv11y7w3Y11sGNWWnNmL19Kd9ZjLL39H95UekYvM7qS7uLbaUy0cr_yFDqHzribW0zJGBj9jycZALWWNVOe4 Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:15.556521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66edd4322b074654b865518b30a0a48e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66edd4322b074654b865518b30a0a48e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: a387e34d4254471cac5af552d2b8eb3f Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-704121256", "metadata": {"Type": "work"}}} Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:15.558630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-704121256', 'metadata': {'Type': 'work'}}}} Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi '' Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:15.559584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:06:15.561082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:06:15.562467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:06:15.562467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:15.570299 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0e9bbc6d-a1b4-4d2d-82ac-0b5da71c0b14 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:15.571475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0e9bbc6d-a1b4-4d2d-82ac-0b5da71c0b14 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030013 Aug 02 09:06:15.572243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 3/3] 10.222.0.46 () {60 vars in 1156 bytes} [Tue Aug 2 09:06:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:06:15.584031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3373b52d-790d-4c23-94a1-ace838e7fac3 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Calling method '.version_select at 0x7f0f2f4df790>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:16.247369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-3373b52d-790d-4c23-94a1-ace838e7fac3 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] HTTP exception thrown: Volume tempest-invalid-178815088 could not be found. Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3373b52d-790d-4c23-94a1-ace838e7fac3 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Request method failure captured: Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-178815088 HTTP/1.1 Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkFfhl1VvQTE8Ojyx-JxQYDns2a8lZvpMhe57imQSUVzeqAd7FwE2kIdK8oKwP8ysMglWvy2gdTeunaorE0-H84Y6rJv11y7w3Y11sGNWWnNmL19Kd9ZjLL39H95UekYvM7qS7uLbaUy0cr_yFDqHzribW0zJGBj9jycZALWWNVOe4 Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:16.256385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66edd4322b074654b865518b30a0a48e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66edd4322b074654b865518b30a0a48e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: a387e34d4254471cac5af552d2b8eb3f Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Volume tempest-invalid-178815088 could not be found. Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'tempest-invalid-178815088'} Aug 02 09:06:16.257978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-178815088 could not be found. (HTTP 404) (Request-ID: req-0b79bf38-a373-4b34-8d3e-de01e7b8f315) Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.258823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:06:16.491176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-178815088 could not be found. Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:16.504298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-178815088 could not be found. Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-178815088 could not be found. Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3373b52d-790d-4c23-94a1-ace838e7fac3 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Returning 404 to user: Volume tempest-invalid-178815088 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3373b52d-790d-4c23-94a1-ace838e7fac3 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-178815088" status: 404 len: 98 microversion: 2.1 time: 0.678985 Aug 02 09:06:16.506601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 4/4] 10.222.0.46 () {58 vars in 1215 bytes} [Tue Aug 2 09:06:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-178815088 => generated 98 bytes in 685 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 09:06:16.511582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e885e055-e7d8-4d18-95d1-02f06ffcfd34 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009808 Aug 02 09:06:16.511582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1140 bytes} [Tue Aug 2 09:06:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 02 09:06:16.511582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-beea0e03-59f8-4da4-abb3-7426f449466b tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004788 Aug 02 09:06:16.511582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1137 bytes} [Tue Aug 2 09:06:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 09:06:16.511582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d973446b-990e-4250-9124-e8aedc49eb76 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Calling method '.version_select at 0x7f0f2f417dc0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:16.953323 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-d973446b-990e-4250-9124-e8aedc49eb76 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] HTTP exception thrown: Volume 87069848-b63b-455f-bda1-54b02b8fc1f9 could not be found. Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d973446b-990e-4250-9124-e8aedc49eb76 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Request method failure captured: Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: DELETE /compute/v2.1/os-volumes/87069848-b63b-455f-bda1-54b02b8fc1f9 HTTP/1.1 Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkFfhl1VvQTE8Ojyx-JxQYDns2a8lZvpMhe57imQSUVzeqAd7FwE2kIdK8oKwP8ysMglWvy2gdTeunaorE0-H84Y6rJv11y7w3Y11sGNWWnNmL19Kd9ZjLL39H95UekYvM7qS7uLbaUy0cr_yFDqHzribW0zJGBj9jycZALWWNVOe4 Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:16.956630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66edd4322b074654b865518b30a0a48e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66edd4322b074654b865518b30a0a48e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: a387e34d4254471cac5af552d2b8eb3f Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Volume 87069848-b63b-455f-bda1-54b02b8fc1f9 could not be found. Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '87069848-b63b-455f-bda1-54b02b8fc1f9'} Aug 02 09:06:16.957809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87069848-b63b-455f-bda1-54b02b8fc1f9 could not be found. (HTTP 404) (Request-ID: req-5dc631fc-e0db-4474-99d4-ed7ef92d7118) Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.958702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:06:16.959788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87069848-b63b-455f-bda1-54b02b8fc1f9 could not be found. Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:06:16.960910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87069848-b63b-455f-bda1-54b02b8fc1f9 could not be found. Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87069848-b63b-455f-bda1-54b02b8fc1f9 could not be found. Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:16.962328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d973446b-990e-4250-9124-e8aedc49eb76 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Returning 404 to user: Volume 87069848-b63b-455f-bda1-54b02b8fc1f9 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:16.963734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d973446b-990e-4250-9124-e8aedc49eb76 tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/87069848-b63b-455f-bda1-54b02b8fc1f9" status: 404 len: 109 microversion: 2.1 time: 0.658946 Aug 02 09:06:16.963734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 7/7] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:06:16 2022] DELETE /compute/v2.1/os-volumes/87069848-b63b-455f-bda1-54b02b8fc1f9 => generated 109 bytes in 661 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:16.974544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bfb58af7-642b-4787-9221-4621666abebe tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Calling method '.version_select at 0x7f0f2f500790>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:17.256489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-bfb58af7-642b-4787-9221-4621666abebe tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] HTTP exception thrown: Volume e26a82a8-83dd-466a-b836-667a3ce7e566 could not be found. Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bfb58af7-642b-4787-9221-4621666abebe tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Request method failure captured: Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/os-volumes/e26a82a8-83dd-466a-b836-667a3ce7e566 HTTP/1.1 Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkFfhl1VvQTE8Ojyx-JxQYDns2a8lZvpMhe57imQSUVzeqAd7FwE2kIdK8oKwP8ysMglWvy2gdTeunaorE0-H84Y6rJv11y7w3Y11sGNWWnNmL19Kd9ZjLL39H95UekYvM7qS7uLbaUy0cr_yFDqHzribW0zJGBj9jycZALWWNVOe4 Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:17.258974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/66edd4322b074654b865518b30a0a48e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_66edd4322b074654b865518b30a0a48e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/66edd4322b074654b865518b30a0a48e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 66edd4322b074654b865518b30a0a48e Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesNegativeTest-1353329319 Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: a387e34d4254471cac5af552d2b8eb3f Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesNegativeTest-1353329319-project Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Volume e26a82a8-83dd-466a-b836-667a3ce7e566 could not be found. Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'e26a82a8-83dd-466a-b836-667a3ce7e566'} Aug 02 09:06:17.263124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e26a82a8-83dd-466a-b836-667a3ce7e566 could not be found. (HTTP 404) (Request-ID: req-7941042d-961d-45a7-9ef3-0c593a880fae) Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:17.263728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:06:17.265456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e26a82a8-83dd-466a-b836-667a3ce7e566 could not be found. Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:06:17.266837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e26a82a8-83dd-466a-b836-667a3ce7e566 could not be found. Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e26a82a8-83dd-466a-b836-667a3ce7e566 could not be found. Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bfb58af7-642b-4787-9221-4621666abebe tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] Returning 404 to user: Volume e26a82a8-83dd-466a-b836-667a3ce7e566 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bfb58af7-642b-4787-9221-4621666abebe tempest-VolumesNegativeTest-1353329319 tempest-VolumesNegativeTest-1353329319-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e26a82a8-83dd-466a-b836-667a3ce7e566" status: 404 len: 109 microversion: 2.1 time: 0.290728 Aug 02 09:06:17.268576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 8/8] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:06:16 2022] GET /compute/v2.1/os-volumes/e26a82a8-83dd-466a-b836-667a3ce7e566 => generated 109 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:06:17.916419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5bcd844b-6f49-4655-b886-c0d86b069dc8 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.702905 Aug 02 09:06:17.917247 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 1/9] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Aug 2 09:06:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3706 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 09:06:17.932317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-14a893be-f9a9-441c-aa93-fcd8010c49c2 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f500940>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:18.069829 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-14a893be-f9a9-441c-aa93-fcd8010c49c2 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06" status: 200 len: 344 microversion: 2.1 time: 0.141714 Aug 02 09:06:18.071384 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 9/10] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:06:17 2022] GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:19.085644 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8e0642a8-0a46-43d7-993f-4aacad01c579 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f492dc0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:19.186920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8e0642a8-0a46-43d7-993f-4aacad01c579 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06" status: 200 len: 344 microversion: 2.1 time: 0.105795 Aug 02 09:06:19.187651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 2/11] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:06:19 2022] GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:20.201334 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8436abc8-7fa4-457d-a73d-5fcf28c8c073 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f417310>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:20.303083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8436abc8-7fa4-457d-a73d-5fcf28c8c073 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06" status: 200 len: 345 microversion: 2.1 time: 0.106104 Aug 02 09:06:20.311103 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 10/12] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:06:20 2022] GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:20.316508 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fda1c5cd-5adc-4d5f-8d07-4d7e9c944a94 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Action: 'create', calling method: .version_select at 0x7f0f2f4a4430>, body: {"snapshot": {"volume_id": "73788cd0-e243-456a-96b6-a2f2d186fd06", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1848129569"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:21.085411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fda1c5cd-5adc-4d5f-8d07-4d7e9c944a94 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.772175 Aug 02 09:06:21.086572 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 3/13] 10.222.0.46 () {60 vars in 1162 bytes} [Tue Aug 2 09:06:20 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:21.099876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-35cc6709-ce2e-43ce-ad6c-cf489744413e tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f431310>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:21.526236 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-35cc6709-ce2e-43ce-ad6c-cf489744413e tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.430023 Aug 02 09:06:21.526830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 11/14] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:21 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:21.537667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2cefe436-54e7-4441-953f-e485349490be tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f4a95e0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:21.600819 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2cefe436-54e7-4441-953f-e485349490be tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.066846 Aug 02 09:06:21.608622 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 4/15] 10.222.0.46 () {58 vars in 1140 bytes} [Tue Aug 2 09:06:21 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:21.613344 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-580e6de1-5f4c-4292-90b5-0b0a3ac32fde tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f431a60>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:21.670600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-580e6de1-5f4c-4292-90b5-0b0a3ac32fde tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.061002 Aug 02 09:06:21.671162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 12/16] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:21 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:22.689752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d73ac475-a697-4afd-bafd-7972393a3ce5 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f4a4280>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:22.803988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d73ac475-a697-4afd-bafd-7972393a3ce5 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.124795 Aug 02 09:06:22.809732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 5/17] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:22 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:23.817594 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9389e07b-f1ec-41f3-a441-7d97567f3ee4 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f4173a0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:23.918418 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9389e07b-f1ec-41f3-a441-7d97567f3ee4 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.103924 Aug 02 09:06:23.918898 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 13/18] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:23 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:24.933318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-272fc2ae-ee0e-4ade-9497-0aa860426f82 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f492ca0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:24.981428 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-272fc2ae-ee0e-4ade-9497-0aa860426f82 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.052240 Aug 02 09:06:24.982437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 6/19] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:24 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:25.996426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-81977d5f-aaa2-4586-9f1f-a865c8c4fde7 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f500940>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:26.117335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-81977d5f-aaa2-4586-9f1f-a865c8c4fde7 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.125517 Aug 02 09:06:26.118422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 14/20] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:25 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:27.130326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-89ca27ea-059d-4133-b515-cf846bee47ac tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f4a9280>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:27.230310 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-89ca27ea-059d-4133-b515-cf846bee47ac tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.103189 Aug 02 09:06:27.230858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 7/21] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:27 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:28.038743 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6ed6c8c2-81b4-4831-a5be-807863000933 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'create', calling method: .version_select at 0x7f0f2f431b80>, body: {"keypair": {"name": "tempest-keypair-1034427762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEk+KD9beAupxAG8OPp8HvRyB7Q8g9xPr7pt+B26hUlzXZjZskaTs3ep5+lzsEB54vwDfHXW+5m1/UvEOPWJ8khgM37CHFQxlAKId7Z3nEok0ZBowte1wWsyJO89jn8O9w=="}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:28.153133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-6ed6c8c2-81b4-4831-a5be-807863000933 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Getting quotas for project 7e47ffad695c4b049ca730c8cc43b9f9. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:28.164059 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-6ed6c8c2-81b4-4831-a5be-807863000933 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Getting quotas for user 50918811a90a444eaf123b2aeb4a75b3 and project 7e47ffad695c4b049ca730c8cc43b9f9. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:28.244940 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dbec31bf-3345-480d-8da3-f9be6ad897e5 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f4a41f0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:28.313540 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dbec31bf-3345-480d-8da3-f9be6ad897e5 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.074656 Aug 02 09:06:28.318871 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 8/22] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:28 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:28.365280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6ed6c8c2-81b4-4831-a5be-807863000933 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.684378 Aug 02 09:06:28.366719 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 15/23] 10.222.0.46 () {62 vars in 1200 bytes} [Tue Aug 2 09:06:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 686 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:28.637731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7192bef9-e21f-4793-b2e6-2ad56f3086b6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: .version_select at 0x7f0f2f4a4b80>, body: {"keypair": {"name": "tempest-keypair-222738723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdp9y/LNKTJyHBJC5bKSyXS9LlTyIdlIC9NZUhUwV9+6J/JA4tnnOrDs89GsSdrFiGfNnrLE54KdR/DQwWt8pd5Ni7Zz/5V9hIOLAI6ObbfAEcH3T4rCNJrs+GVOAXtdA=="}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:28.695797 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-814827137", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:28.798773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-7192bef9-e21f-4793-b2e6-2ad56f3086b6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for project b9df882a572a4bed8966779e50eb7e7c. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:28.823219 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-7192bef9-e21f-4793-b2e6-2ad56f3086b6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for user 806f0c03435e4c5daeadaa4eb437d936 and project b9df882a572a4bed8966779e50eb7e7c. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:28.928529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] validate_networks() for [('e629e91f-1fcf-4cf9-963e-2719f3797502', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:06:29.052904 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7192bef9-e21f-4793-b2e6-2ad56f3086b6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.737603 Aug 02 09:06:29.057281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 9/24] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:06:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:29.329481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d8f79102-d21a-4c62-b09c-5e023ff8649c tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f42d310>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:29.393672 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d8f79102-d21a-4c62-b09c-5e023ff8649c tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 288 microversion: 2.1 time: 0.070892 Aug 02 09:06:29.394744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 10/25] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:29 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:29.417549 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3512dfe1-5255-4228-9d6f-3c047a779572 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f42d940>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:29.670137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3512dfe1-5255-4228-9d6f-3c047a779572 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 202 len: 0 microversion: 2.1 time: 0.268290 Aug 02 09:06:29.673845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 11/26] 10.222.0.46 () {58 vars in 1254 bytes} [Tue Aug 2 09:06:29 2022] DELETE /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:06:29.679284 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f553f10b-f43d-4a40-8aab-b6a15cbfbafd tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2ebc5040>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:30.042450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f553f10b-f43d-4a40-8aab-b6a15cbfbafd tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.367139 Aug 02 09:06:30.043298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 12/27] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:29 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:31.056146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fe27ee21-8724-478d-ba3e-f695396ea9fa tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2f42ddc0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:31.117172 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fe27ee21-8724-478d-ba3e-f695396ea9fa tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.065366 Aug 02 09:06:31.118208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 13/28] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:31 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:06:31.429264 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:06:31.429716 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:06:31.430246 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:06:31.431051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:06:31.431607 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:06:31.454677 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:31.458712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:31.462221 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:31.462958 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:31.547560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Getting quotas for project 259e864bb08645c79dfab23aa56d8822. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:31.583242 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Getting quotas for user 7fd6b148658e4c2884a32f66326833b6 and project 259e864bb08645c79dfab23aa56d8822. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:31.621510 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:06:31.630527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:06:31.847667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-309b39fb-447b-4e3c-957d-805083b36e11 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.436330 Aug 02 09:06:31.852750 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 16/29] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:06:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 3441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:06:31.874096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a6d6b3a7-3eb5-45c0-b271-4fa7db9f59d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:31.874096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a6d6b3a7-3eb5-45c0-b271-4fa7db9f59d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:32.133069 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a6c5a0ce-0b8b-4425-8e14-a1e44ff900c7 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2eae54c0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:32.209329 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a6c5a0ce-0b8b-4425-8e14-a1e44ff900c7 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 200 len: 287 microversion: 2.1 time: 0.080837 Aug 02 09:06:32.216231 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 17/30] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:32 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:32.632489 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a6d6b3a7-3eb5-45c0-b271-4fa7db9f59d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:32.674350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a6d6b3a7-3eb5-45c0-b271-4fa7db9f59d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1221 microversion: 2.1 time: 0.812001 Aug 02 09:06:32.678996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 14/31] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:31 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1221 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:32.990655 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1649521848", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:33.149225 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] validate_networks() for [('e629e91f-1fcf-4cf9-963e-2719f3797502', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:06:33.240528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ea5da3b4-8e44-44bb-b402-060ed9853cb2 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2ebc5820>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:33.284661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-ea5da3b4-8e44-44bb-b402-060ed9853cb2 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] HTTP exception thrown: Snapshot 43a535a8-f747-462f-84e7-ec0ce79bed1b could not be found. Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ea5da3b4-8e44-44bb-b402-060ed9853cb2 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Request method failure captured: Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b HTTP/1.1 Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkGallTurkAH1-oY6lgnDxiab1r4rh1HmeEfHWEm__by4qtLA8E-kZiEs4d-M3_s9QGXy9zT72oP0lLeiVUrAPRU-EDlEN7bCQue3IfO2EipmDjGsOLLi1B0Y1E_11EPr7HRgQJelIMMyJI3WZY5FX-eqIUwS75M339EUUfFAuh86Y Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: edc8f82022af4e398c2c0fbfe555ef88 Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:06:33.288745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: edc8f82022af4e398c2c0fbfe555ef88 Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-VolumesSnapshotsTestJSON-661050843-project Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 87af3620e39a4009905152fcda5a8e23 Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-VolumesSnapshotsTestJSON-661050843-project Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Snapshot 43a535a8-f747-462f-84e7-ec0ce79bed1b could not be found. Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '43a535a8-f747-462f-84e7-ec0ce79bed1b'} Aug 02 09:06:33.289957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 43a535a8-f747-462f-84e7-ec0ce79bed1b could not be found. (HTTP 404) (Request-ID: req-75e6114a-d9f1-484d-a388-efe904b2f7d4) Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:06:33.290627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:06:33.291680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 43a535a8-f747-462f-84e7-ec0ce79bed1b could not be found. Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 09:06:33.293387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 43a535a8-f747-462f-84e7-ec0ce79bed1b could not be found. Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 43a535a8-f747-462f-84e7-ec0ce79bed1b could not be found. Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:06:33.294394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ea5da3b4-8e44-44bb-b402-060ed9853cb2 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Returning 404 to user: Snapshot 43a535a8-f747-462f-84e7-ec0ce79bed1b could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:33.298063 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ea5da3b4-8e44-44bb-b402-060ed9853cb2 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b" status: 404 len: 111 microversion: 2.1 time: 0.068312 Aug 02 09:06:33.298698 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 15/32] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:06:33 2022] GET /compute/v2.1/os-snapshots/43a535a8-f747-462f-84e7-ec0ce79bed1b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:06:33.311216 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-36c11e84-a68b-4e02-90a3-a25f7b2eeb31 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2ebc5550>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:33.713600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-36c11e84-a68b-4e02-90a3-a25f7b2eeb31 tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06" status: 202 len: 0 microversion: 2.1 time: 0.409493 Aug 02 09:06:33.715855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 16/33] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:06:33 2022] DELETE /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:06:33.737199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-751484352", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ea4ad1-853e-4fff-8e6d-c1cd8407e938"}], "security_groups": [{"name": "tempest-securitygroup--266923789"}], "key_name": "tempest-keypair-1034427762", "user_data": "}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:34.076911 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] validate_networks() for [('21ea4ad1-853e-4fff-8e6d-c1cd8407e938', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:06:35.218548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:06:35.219021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:06:35.219436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:06:35.219850 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:06:35.220266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:06:35.252449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:35.259108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:35.259108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:35.259108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:35.320252 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Getting quotas for project 259e864bb08645c79dfab23aa56d8822. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:35.337598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Getting quotas for user 7fd6b148658e4c2884a32f66326833b6 and project 259e864bb08645c79dfab23aa56d8822. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:35.342591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:06:35.343153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:06:35.343720 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:06:35.344327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:06:35.344747 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:06:35.374379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:35.375104 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:35.377142 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:35.380763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:35.388120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:06:35.394791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:06:35.435964 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Getting quotas for project 7e47ffad695c4b049ca730c8cc43b9f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:35.443893 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Getting quotas for user 50918811a90a444eaf123b2aeb4a75b3 and project 7e47ffad695c4b049ca730c8cc43b9f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:35.465323 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:06:35.469916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:06:35.583953 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1df94d1a-9a85-4ee4-89ce-9c353eeab3a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.600003 Aug 02 09:06:35.596227 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 18/34] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:06:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:06:35.613046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-79cd63c8-6120-483d-b5ef-6b59076190ba tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2eaece50>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:35.656804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-79cd63c8-6120-483d-b5ef-6b59076190ba tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] HTTP exception thrown: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-79cd63c8-6120-483d-b5ef-6b59076190ba tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Request method failure captured: Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 HTTP/1.1 Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkGallTurkAH1-oY6lgnDxiab1r4rh1HmeEfHWEm__by4qtLA8E-kZiEs4d-M3_s9QGXy9zT72oP0lLeiVUrAPRU-EDlEN7bCQue3IfO2EipmDjGsOLLi1B0Y1E_11EPr7HRgQJelIMMyJI3WZY5FX-eqIUwS75M339EUUfFAuh86Y Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: edc8f82022af4e398c2c0fbfe555ef88 Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:35.659167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: edc8f82022af4e398c2c0fbfe555ef88 Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesSnapshotsTestJSON-661050843-project Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 87af3620e39a4009905152fcda5a8e23 Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesSnapshotsTestJSON-661050843-project Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '73788cd0-e243-456a-96b6-a2f2d186fd06'} Aug 02 09:06:35.660357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. (HTTP 404) (Request-ID: req-c8500778-7552-40e2-bc51-5853006654bd) Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:35.661006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:06:35.663673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:06:35.666023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-79cd63c8-6120-483d-b5ef-6b59076190ba tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Returning 404 to user: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-79cd63c8-6120-483d-b5ef-6b59076190ba tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06" status: 404 len: 109 microversion: 2.1 time: 0.060506 Aug 02 09:06:35.668485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 19/35] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:06:35 2022] GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:35.730530 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c16ee94d-3e11-41a8-bbe2-de137f2519dd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.012639 Aug 02 09:06:35.731198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 17/36] 10.222.0.46 () {62 vars in 1188 bytes} [Tue Aug 2 09:06:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 09:06:35.738213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c4b78e40-17d9-41dc-b6aa-16763dd18f50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:35.739052 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c4b78e40-17d9-41dc-b6aa-16763dd18f50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:35.865214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c4b78e40-17d9-41dc-b6aa-16763dd18f50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:35.877788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c4b78e40-17d9-41dc-b6aa-16763dd18f50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1222 microversion: 2.1 time: 0.144212 Aug 02 09:06:35.892836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 18/37] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:35 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:35.898601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1165565944", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "406c2791-4e79-4511-a29d-6d14a120682a"}], "security_groups": [{"name": "tempest-securitygroup--580819460"}], "key_name": "tempest-keypair-222738723", "user_data": "}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:35.989601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-979418282", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "networks": [{"uuid": "ab337da9-e3e8-46c5-9d6e-be87ab7e0347"}]}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:36.158218 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] validate_networks() for [('ab337da9-e3e8-46c5-9d6e-be87ab7e0347', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:06:36.165350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] validate_networks() for [('406c2791-4e79-4511-a29d-6d14a120682a', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:06:36.766591 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:06:36.767161 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:06:36.767925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:06:36.768402 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:06:36.769180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:06:36.780368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:36.781148 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:36.782208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:36.782785 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:36.815852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Getting quotas for project b198992cc0014c6a9c25374d24fb01a9. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:36.823724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Getting quotas for user 3b9d9cfdcaac473786d3017f73163274 and project b198992cc0014c6a9c25374d24fb01a9. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:36.838662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:06:36.847042 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:06:37.020514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:06:37.021033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:06:37.021821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:06:37.022417 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:06:37.022833 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:06:37.037051 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:37.037524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:37.038364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:37.038978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:37.062550 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-88f75ae1-dac9-44ed-91c9-3ea51d7a1fa5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400256 Aug 02 09:06:37.066732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 20/38] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:06:37.081224 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3a8f71f1-9549-4a3e-8208-515f06eec8bc tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2eaf9700>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:37.091357 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for project b9df882a572a4bed8966779e50eb7e7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:06:37.099482 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for user 806f0c03435e4c5daeadaa4eb437d936 and project b9df882a572a4bed8966779e50eb7e7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:06:37.166653 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:06:37.169575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:06:37.175574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-3a8f71f1-9549-4a3e-8208-515f06eec8bc tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] HTTP exception thrown: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3a8f71f1-9549-4a3e-8208-515f06eec8bc tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Request method failure captured: Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: DELETE /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 HTTP/1.1 Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkGallTurkAH1-oY6lgnDxiab1r4rh1HmeEfHWEm__by4qtLA8E-kZiEs4d-M3_s9QGXy9zT72oP0lLeiVUrAPRU-EDlEN7bCQue3IfO2EipmDjGsOLLi1B0Y1E_11EPr7HRgQJelIMMyJI3WZY5FX-eqIUwS75M339EUUfFAuh86Y Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: edc8f82022af4e398c2c0fbfe555ef88 Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:37.181272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: edc8f82022af4e398c2c0fbfe555ef88 Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesSnapshotsTestJSON-661050843-project Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 87af3620e39a4009905152fcda5a8e23 Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesSnapshotsTestJSON-661050843-project Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '73788cd0-e243-456a-96b6-a2f2d186fd06'} Aug 02 09:06:37.182409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. (HTTP 404) (Request-ID: req-8b4db8e0-9299-488e-b4bb-2510eb04066a) Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:37.183578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:06:37.184484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:06:37.185472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3a8f71f1-9549-4a3e-8208-515f06eec8bc tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Returning 404 to user: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3a8f71f1-9549-4a3e-8208-515f06eec8bc tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06" status: 404 len: 109 microversion: 2.1 time: 0.112010 Aug 02 09:06:37.188727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 21/39] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:06:37 2022] DELETE /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:37.200835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f215886b-1971-44e0-a645-b51f40d56116 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:37.204201 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f215886b-1971-44e0-a645-b51f40d56116 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:37.389779 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f215886b-1971-44e0-a645-b51f40d56116 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:37.438208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f215886b-1971-44e0-a645-b51f40d56116 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:37.440439 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f215886b-1971-44e0-a645-b51f40d56116 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:37.441780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f215886b-1971-44e0-a645-b51f40d56116 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1281 microversion: 2.20 time: 0.260021 Aug 02 09:06:37.442567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 22/40] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:37 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1281 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:37.466729 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cba00889-9e7e-4e17-889e-ac85797adc17 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:37.469927 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cba00889-9e7e-4e17-889e-ac85797adc17 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:37.480347 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0e67a98d-548c-48ed-a191-6f45e7a89dca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.585409 Aug 02 09:06:37.481462 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 19/41] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:06:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:06:37.486484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e3910648-5534-4c09-b56d-5afdac35f95c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:37.499256 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e3910648-5534-4c09-b56d-5afdac35f95c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:37.544787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cba00889-9e7e-4e17-889e-ac85797adc17 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:37.556162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cba00889-9e7e-4e17-889e-ac85797adc17 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1222 microversion: 2.1 time: 0.099447 Aug 02 09:06:37.557866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 23/42] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:37 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:37.581457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0970ca1a-e8d0-4d8d-800a-e83dbe7b457f tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Calling method '.version_select at 0x7f0f2da9e790>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:37.688678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e3910648-5534-4c09-b56d-5afdac35f95c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:37.699245 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e3910648-5534-4c09-b56d-5afdac35f95c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1214 microversion: 2.1 time: 0.216361 Aug 02 09:06:37.699835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 20/43] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:37 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:37.714837 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a45ff077-a33c-4a3b-b985-b686d2060dd8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:37.717099 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a45ff077-a33c-4a3b-b985-b686d2060dd8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:37.783942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a45ff077-a33c-4a3b-b985-b686d2060dd8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:37.801644 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a45ff077-a33c-4a3b-b985-b686d2060dd8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1241 microversion: 2.1 time: 0.087910 Aug 02 09:06:37.817007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 21/44] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:37 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:38.351048 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-0970ca1a-e8d0-4d8d-800a-e83dbe7b457f tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] HTTP exception thrown: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0970ca1a-e8d0-4d8d-800a-e83dbe7b457f tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Request method failure captured: Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 HTTP/1.1 Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkGallTurkAH1-oY6lgnDxiab1r4rh1HmeEfHWEm__by4qtLA8E-kZiEs4d-M3_s9QGXy9zT72oP0lLeiVUrAPRU-EDlEN7bCQue3IfO2EipmDjGsOLLi1B0Y1E_11EPr7HRgQJelIMMyJI3WZY5FX-eqIUwS75M339EUUfFAuh86Y Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: edc8f82022af4e398c2c0fbfe555ef88 Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:06:38.356006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/edc8f82022af4e398c2c0fbfe555ef88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: edc8f82022af4e398c2c0fbfe555ef88 Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-661050843 Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesSnapshotsTestJSON-661050843-project Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 87af3620e39a4009905152fcda5a8e23 Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesSnapshotsTestJSON-661050843-project Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '73788cd0-e243-456a-96b6-a2f2d186fd06'} Aug 02 09:06:38.357983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. (HTTP 404) (Request-ID: req-d4390470-dee2-443c-93b1-fe698b2da87e) Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:38.359139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:06:38.362415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:06:38.366823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:06:38.372895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0970ca1a-e8d0-4d8d-800a-e83dbe7b457f tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] Returning 404 to user: Volume 73788cd0-e243-456a-96b6-a2f2d186fd06 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:06:38.394702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0970ca1a-e8d0-4d8d-800a-e83dbe7b457f tempest-VolumesSnapshotsTestJSON-661050843 tempest-VolumesSnapshotsTestJSON-661050843-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06" status: 404 len: 109 microversion: 2.1 time: 0.830895 Aug 02 09:06:38.395597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 24/45] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:06:37 2022] GET /compute/v2.1/os-volumes/73788cd0-e243-456a-96b6-a2f2d186fd06 => generated 109 bytes in 837 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:06:38.471260 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:38.472439 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:38.486313 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:38.489308 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:38.490418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:38.493217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:38.584015 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-138171ae-1a51-49fb-86ba-7d9f10a2ac2d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:38.585477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-138171ae-1a51-49fb-86ba-7d9f10a2ac2d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:38.604094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-138171ae-1a51-49fb-86ba-7d9f10a2ac2d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:38.609970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-138171ae-1a51-49fb-86ba-7d9f10a2ac2d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:38.615902 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-138171ae-1a51-49fb-86ba-7d9f10a2ac2d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:38.616695 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-138171ae-1a51-49fb-86ba-7d9f10a2ac2d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:39.034644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-138171ae-1a51-49fb-86ba-7d9f10a2ac2d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:39.068600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-138171ae-1a51-49fb-86ba-7d9f10a2ac2d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1218 microversion: 2.1 time: 0.489679 Aug 02 09:06:39.069207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 25/46] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:38 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1218 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:39.079812 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4d22048b-1a2d-41ca-98a8-b4616e7e9c92 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:39.080647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4d22048b-1a2d-41ca-98a8-b4616e7e9c92 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:39.109956 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:39.139838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:39.141646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:39.152629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2fdd97b2-ed14-433f-8721-8ff1490106d2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1277 microversion: 2.20 time: 0.686622 Aug 02 09:06:39.156626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 22/47] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:38 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1277 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:39.162341 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-62d1a96e-ceef-4e72-8b8c-e40b0d8ee0fc tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:39.165824 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-62d1a96e-ceef-4e72-8b8c-e40b0d8ee0fc tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:39.264390 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4d22048b-1a2d-41ca-98a8-b4616e7e9c92 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:39.274283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4d22048b-1a2d-41ca-98a8-b4616e7e9c92 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1214 microversion: 2.1 time: 0.201053 Aug 02 09:06:39.274865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 26/48] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:39 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:39.327422 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-62d1a96e-ceef-4e72-8b8c-e40b0d8ee0fc tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:39.338156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-62d1a96e-ceef-4e72-8b8c-e40b0d8ee0fc tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1241 microversion: 2.1 time: 0.180082 Aug 02 09:06:39.338746 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 23/49] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:39 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:40.093199 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ffc371da-49a9-49fc-b149-2de14cdd7cd4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:40.094006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ffc371da-49a9-49fc-b149-2de14cdd7cd4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:40.100286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffc371da-49a9-49fc-b149-2de14cdd7cd4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.100738 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffc371da-49a9-49fc-b149-2de14cdd7cd4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.101520 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffc371da-49a9-49fc-b149-2de14cdd7cd4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.101988 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffc371da-49a9-49fc-b149-2de14cdd7cd4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.169052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ffc371da-49a9-49fc-b149-2de14cdd7cd4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:40.178830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ffc371da-49a9-49fc-b149-2de14cdd7cd4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1218 microversion: 2.1 time: 0.088984 Aug 02 09:06:40.180404 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 27/50] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:40 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:40.183645 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:40.184982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:40.192342 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.192917 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.193812 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.194434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.263207 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:40.271863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:40.273635 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:40.275504 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-93522676-7861-46b5-84af-4b98f5ee73bd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1277 microversion: 2.20 time: 0.096815 Aug 02 09:06:40.276651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 24/51] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:40 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:40.300394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-12f2f9d7-1e6c-4754-a398-7040773b686a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:40.300394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-12f2f9d7-1e6c-4754-a398-7040773b686a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:40.325838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12f2f9d7-1e6c-4754-a398-7040773b686a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.326400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12f2f9d7-1e6c-4754-a398-7040773b686a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.327160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12f2f9d7-1e6c-4754-a398-7040773b686a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.328012 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12f2f9d7-1e6c-4754-a398-7040773b686a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.360698 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d419a6bf-83ce-4dc5-bb3c-832e30c6be48 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:40.362304 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d419a6bf-83ce-4dc5-bb3c-832e30c6be48 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:40.379527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d419a6bf-83ce-4dc5-bb3c-832e30c6be48 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.381636 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d419a6bf-83ce-4dc5-bb3c-832e30c6be48 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.382516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d419a6bf-83ce-4dc5-bb3c-832e30c6be48 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:40.383291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d419a6bf-83ce-4dc5-bb3c-832e30c6be48 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:40.419239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-12f2f9d7-1e6c-4754-a398-7040773b686a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:40.446928 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-12f2f9d7-1e6c-4754-a398-7040773b686a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1218 microversion: 2.1 time: 0.154247 Aug 02 09:06:40.461297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 28/52] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:40 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:40.488671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d419a6bf-83ce-4dc5-bb3c-832e30c6be48 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:40.497186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d419a6bf-83ce-4dc5-bb3c-832e30c6be48 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1245 microversion: 2.1 time: 0.142533 Aug 02 09:06:40.497768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 25/53] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:40 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1245 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:41.201776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9e4aa439-8871-4b97-a0fe-3be4ef658941 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:41.202424 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9e4aa439-8871-4b97-a0fe-3be4ef658941 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:41.216501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e4aa439-8871-4b97-a0fe-3be4ef658941 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.216501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e4aa439-8871-4b97-a0fe-3be4ef658941 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.216501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e4aa439-8871-4b97-a0fe-3be4ef658941 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.216501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e4aa439-8871-4b97-a0fe-3be4ef658941 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.282869 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9e4aa439-8871-4b97-a0fe-3be4ef658941 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:41.290759 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9e4aa439-8871-4b97-a0fe-3be4ef658941 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1218 microversion: 2.1 time: 0.093246 Aug 02 09:06:41.291343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 29/54] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:41 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:41.298151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:41.298793 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:41.305196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.305668 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.306484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.306932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.382274 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:41.390692 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:41.392229 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:41.393360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-99c4a8d0-1257-4291-9833-65342cbe7e5e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1333 microversion: 2.20 time: 0.099203 Aug 02 09:06:41.393948 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 26/55] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:41 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:41.470696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5b7db1a0-ea41-462c-8790-bc086a97f2ad tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:41.471278 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5b7db1a0-ea41-462c-8790-bc086a97f2ad tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:41.477540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b7db1a0-ea41-462c-8790-bc086a97f2ad tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.478132 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b7db1a0-ea41-462c-8790-bc086a97f2ad tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.478919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b7db1a0-ea41-462c-8790-bc086a97f2ad tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.479850 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b7db1a0-ea41-462c-8790-bc086a97f2ad tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.519578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-817a8ac0-ae96-4ce8-b903-66f159ae651c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:41.520345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-817a8ac0-ae96-4ce8-b903-66f159ae651c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:41.530451 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-817a8ac0-ae96-4ce8-b903-66f159ae651c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.531011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-817a8ac0-ae96-4ce8-b903-66f159ae651c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.532029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-817a8ac0-ae96-4ce8-b903-66f159ae651c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:41.536585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-817a8ac0-ae96-4ce8-b903-66f159ae651c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:41.548513 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5b7db1a0-ea41-462c-8790-bc086a97f2ad tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:41.558702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5b7db1a0-ea41-462c-8790-bc086a97f2ad tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1218 microversion: 2.1 time: 0.092017 Aug 02 09:06:41.559310 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 30/56] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:41 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:41.633738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-817a8ac0-ae96-4ce8-b903-66f159ae651c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:41.644011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-817a8ac0-ae96-4ce8-b903-66f159ae651c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1245 microversion: 2.1 time: 0.130234 Aug 02 09:06:41.644768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 27/57] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:41 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:42.312726 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1dc0785f-258c-407b-89fe-00cba40f100e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:42.313323 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1dc0785f-258c-407b-89fe-00cba40f100e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:42.319768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1dc0785f-258c-407b-89fe-00cba40f100e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.320219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1dc0785f-258c-407b-89fe-00cba40f100e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.320989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1dc0785f-258c-407b-89fe-00cba40f100e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.321424 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1dc0785f-258c-407b-89fe-00cba40f100e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.404703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1dc0785f-258c-407b-89fe-00cba40f100e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:42.415053 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1dc0785f-258c-407b-89fe-00cba40f100e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1218 microversion: 2.1 time: 0.106193 Aug 02 09:06:42.415631 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 31/58] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:42 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:42.416928 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:42.417821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:42.431656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.432880 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.433825 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.434461 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.528952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:42.547257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:42.550346 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:42.551718 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-97e5dd85-ac2a-4ab4-b3ea-4a4bf8039d52 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1333 microversion: 2.20 time: 0.139168 Aug 02 09:06:42.847821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 28/59] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:42 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1333 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:06:42.849978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5b98431a-39c7-4bbd-9095-57fd398ec677 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:42.849978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5b98431a-39c7-4bbd-9095-57fd398ec677 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:42.849978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b98431a-39c7-4bbd-9095-57fd398ec677 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.849978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b98431a-39c7-4bbd-9095-57fd398ec677 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.852001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b98431a-39c7-4bbd-9095-57fd398ec677 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.852001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b98431a-39c7-4bbd-9095-57fd398ec677 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.853177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f1b4c9cb-ca9b-4cfe-bff8-0956bb968fc7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:42.853177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f1b4c9cb-ca9b-4cfe-bff8-0956bb968fc7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:42.853177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f1b4c9cb-ca9b-4cfe-bff8-0956bb968fc7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.853177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f1b4c9cb-ca9b-4cfe-bff8-0956bb968fc7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.855109 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f1b4c9cb-ca9b-4cfe-bff8-0956bb968fc7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:42.855109 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f1b4c9cb-ca9b-4cfe-bff8-0956bb968fc7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:42.856045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5b98431a-39c7-4bbd-9095-57fd398ec677 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:42.856045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5b98431a-39c7-4bbd-9095-57fd398ec677 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1218 microversion: 2.1 time: 0.144121 Aug 02 09:06:42.856045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 32/60] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:42 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:42.857349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f1b4c9cb-ca9b-4cfe-bff8-0956bb968fc7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:42.857349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f1b4c9cb-ca9b-4cfe-bff8-0956bb968fc7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1245 microversion: 2.1 time: 0.111351 Aug 02 09:06:42.857349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 29/61] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:42 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:43.437425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-38c93e2a-a863-4f27-8932-8de92041260c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:43.438275 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-38c93e2a-a863-4f27-8932-8de92041260c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:43.445929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-38c93e2a-a863-4f27-8932-8de92041260c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:43.452468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-38c93e2a-a863-4f27-8932-8de92041260c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.452468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-38c93e2a-a863-4f27-8932-8de92041260c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:43.452468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-38c93e2a-a863-4f27-8932-8de92041260c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.528437 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-38c93e2a-a863-4f27-8932-8de92041260c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:43.539158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-38c93e2a-a863-4f27-8932-8de92041260c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1218 microversion: 2.1 time: 0.106296 Aug 02 09:06:43.539568 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 33/62] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:43 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:43.580819 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:43.581506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:43.592887 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:43.593196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.594065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:43.594590 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.672096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:43.682505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:43.685420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:43.687576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f4bcc05e-293f-4b1d-b931-52aefd917faa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1333 microversion: 2.20 time: 0.115744 Aug 02 09:06:43.688939 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 30/63] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:43 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:43.853764 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a9289331-62e0-4589-a25d-fa620b71ac51 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:43.854077 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-70259687-c3ac-4d54-bdf3-a1be33f4df6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:43.854825 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a9289331-62e0-4589-a25d-fa620b71ac51 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:43.855044 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-70259687-c3ac-4d54-bdf3-a1be33f4df6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:43.869552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-70259687-c3ac-4d54-bdf3-a1be33f4df6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:43.870791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-70259687-c3ac-4d54-bdf3-a1be33f4df6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.872095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-70259687-c3ac-4d54-bdf3-a1be33f4df6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:43.874314 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-70259687-c3ac-4d54-bdf3-a1be33f4df6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.875607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a9289331-62e0-4589-a25d-fa620b71ac51 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:43.876060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a9289331-62e0-4589-a25d-fa620b71ac51 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.877174 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a9289331-62e0-4589-a25d-fa620b71ac51 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:43.877808 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a9289331-62e0-4589-a25d-fa620b71ac51 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:43.970774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a9289331-62e0-4589-a25d-fa620b71ac51 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:43.992472 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a9289331-62e0-4589-a25d-fa620b71ac51 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1218 microversion: 2.1 time: 0.139763 Aug 02 09:06:43.992823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 31/64] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:43 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:44.039826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-70259687-c3ac-4d54-bdf3-a1be33f4df6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:44.049021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-70259687-c3ac-4d54-bdf3-a1be33f4df6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1245 microversion: 2.1 time: 0.200150 Aug 02 09:06:44.068619 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 34/65] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:43 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1245 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:44.564081 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-98d4675b-751f-4c2a-aa41-d7932dcb3280 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:44.566714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-98d4675b-751f-4c2a-aa41-d7932dcb3280 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:44.574043 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-98d4675b-751f-4c2a-aa41-d7932dcb3280 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:44.574672 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-98d4675b-751f-4c2a-aa41-d7932dcb3280 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:44.575601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-98d4675b-751f-4c2a-aa41-d7932dcb3280 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:44.576043 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-98d4675b-751f-4c2a-aa41-d7932dcb3280 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:44.646587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-98d4675b-751f-4c2a-aa41-d7932dcb3280 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:44.655302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-98d4675b-751f-4c2a-aa41-d7932dcb3280 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1274 microversion: 2.1 time: 0.095178 Aug 02 09:06:44.668496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 32/66] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:44 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:44.716535 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:44.717133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:44.725583 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:44.728158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:44.729103 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:44.730359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:44.821090 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:44.838378 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:44.840233 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:44.841445 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ebbf200a-12d9-4df2-bd5a-e9d7ab8e9f4d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1333 microversion: 2.20 time: 0.130226 Aug 02 09:06:44.842052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 35/67] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:44 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1333 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:45.012382 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-96a643f1-12d8-40cd-b300-d77c4702b7ed tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:45.012996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-96a643f1-12d8-40cd-b300-d77c4702b7ed tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:45.019367 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96a643f1-12d8-40cd-b300-d77c4702b7ed tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.020020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96a643f1-12d8-40cd-b300-d77c4702b7ed tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.021128 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96a643f1-12d8-40cd-b300-d77c4702b7ed tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.021818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96a643f1-12d8-40cd-b300-d77c4702b7ed tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.075496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4d331f36-4d8b-49bd-a20b-35584b642bec tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:45.076492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4d331f36-4d8b-49bd-a20b-35584b642bec tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:45.084311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4d331f36-4d8b-49bd-a20b-35584b642bec tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.085443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4d331f36-4d8b-49bd-a20b-35584b642bec tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.086076 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4d331f36-4d8b-49bd-a20b-35584b642bec tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.086503 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4d331f36-4d8b-49bd-a20b-35584b642bec tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.144942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-96a643f1-12d8-40cd-b300-d77c4702b7ed tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:45.156573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-96a643f1-12d8-40cd-b300-d77c4702b7ed tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1218 microversion: 2.1 time: 0.147988 Aug 02 09:06:45.166585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 33/68] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:45 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:45.208051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4d331f36-4d8b-49bd-a20b-35584b642bec tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:45.223017 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4d331f36-4d8b-49bd-a20b-35584b642bec tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1245 microversion: 2.1 time: 0.151469 Aug 02 09:06:45.223876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 36/69] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:45 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1245 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:45.681156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c8c0738d-09a7-4266-a276-87fffd3ae94d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:45.690277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c8c0738d-09a7-4266-a276-87fffd3ae94d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:45.692205 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8c0738d-09a7-4266-a276-87fffd3ae94d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.693017 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8c0738d-09a7-4266-a276-87fffd3ae94d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.694388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8c0738d-09a7-4266-a276-87fffd3ae94d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.696180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8c0738d-09a7-4266-a276-87fffd3ae94d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.794744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c8c0738d-09a7-4266-a276-87fffd3ae94d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:45.805373 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c8c0738d-09a7-4266-a276-87fffd3ae94d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1274 microversion: 2.1 time: 0.131188 Aug 02 09:06:45.807639 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 34/70] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:45 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:45.898791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:45.898791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:45.898791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.898791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.899923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:45.899923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:45.967526 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:45.972450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:45.974283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:45.975879 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-900adb32-dfd5-4ec8-b08f-caa07c4bf6ab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1333 microversion: 2.20 time: 0.115349 Aug 02 09:06:45.977563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 37/71] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:45 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:46.184156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c8561f57-3ac2-4b48-95f2-6e6c7ed922e3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:46.184156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c8561f57-3ac2-4b48-95f2-6e6c7ed922e3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:46.193696 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8561f57-3ac2-4b48-95f2-6e6c7ed922e3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:46.193845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8561f57-3ac2-4b48-95f2-6e6c7ed922e3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:46.194657 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8561f57-3ac2-4b48-95f2-6e6c7ed922e3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:46.195086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8561f57-3ac2-4b48-95f2-6e6c7ed922e3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:46.252993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3e096e8e-4973-45f7-a365-fcc1637b32f5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:46.254126 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3e096e8e-4973-45f7-a365-fcc1637b32f5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:46.268084 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e096e8e-4973-45f7-a365-fcc1637b32f5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:46.269141 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e096e8e-4973-45f7-a365-fcc1637b32f5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:46.270461 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e096e8e-4973-45f7-a365-fcc1637b32f5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:46.271140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e096e8e-4973-45f7-a365-fcc1637b32f5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:46.330351 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c8561f57-3ac2-4b48-95f2-6e6c7ed922e3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:46.345764 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c8561f57-3ac2-4b48-95f2-6e6c7ed922e3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1218 microversion: 2.1 time: 0.169038 Aug 02 09:06:46.346582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 35/72] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:46 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:46.499828 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3e096e8e-4973-45f7-a365-fcc1637b32f5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:46.528574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3e096e8e-4973-45f7-a365-fcc1637b32f5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1245 microversion: 2.1 time: 0.271359 Aug 02 09:06:46.532211 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 38/73] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:46 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1245 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:46.836298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3001c022-e10b-428b-a658-383767298c36 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:46.840739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3001c022-e10b-428b-a658-383767298c36 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:46.849692 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3001c022-e10b-428b-a658-383767298c36 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:46.851327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3001c022-e10b-428b-a658-383767298c36 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:46.852621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3001c022-e10b-428b-a658-383767298c36 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:46.853144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3001c022-e10b-428b-a658-383767298c36 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:46.993818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3001c022-e10b-428b-a658-383767298c36 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:47.002562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:47.003328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:47.005739 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=6 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:47.008291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3001c022-e10b-428b-a658-383767298c36 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1274 microversion: 2.1 time: 0.176947 Aug 02 09:06:47.008512 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:47.009485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 36/74] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:46 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:47.016156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:47.016609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:47.017656 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:47.018486 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:47.182710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:47.231185 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:47.243970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:47.255436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d9b4c0b9-d749-48d6-af73-dffdc50e34ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1333 microversion: 2.20 time: 0.251675 Aug 02 09:06:47.255877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 39/75] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:46 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1333 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:47.372598 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-36ededa7-a630-411d-87f1-98c4a5880089 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:47.373949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-36ededa7-a630-411d-87f1-98c4a5880089 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:47.388949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=4 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:47.392675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-36ededa7-a630-411d-87f1-98c4a5880089 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:47.393550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-36ededa7-a630-411d-87f1-98c4a5880089 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:47.395204 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-36ededa7-a630-411d-87f1-98c4a5880089 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:47.396445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-36ededa7-a630-411d-87f1-98c4a5880089 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:47.537204 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0d3eadca-5190-423d-a3c4-807f16591573 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:47.537929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0d3eadca-5190-423d-a3c4-807f16591573 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:47.544596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0d3eadca-5190-423d-a3c4-807f16591573 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:47.545065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0d3eadca-5190-423d-a3c4-807f16591573 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:47.546177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0d3eadca-5190-423d-a3c4-807f16591573 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:47.546889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0d3eadca-5190-423d-a3c4-807f16591573 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:47.602551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-36ededa7-a630-411d-87f1-98c4a5880089 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:47.611531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-36ededa7-a630-411d-87f1-98c4a5880089 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1210 microversion: 2.1 time: 0.246224 Aug 02 09:06:47.614289 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 37/76] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:47 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1210 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:47.674054 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0d3eadca-5190-423d-a3c4-807f16591573 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:47.674054 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0d3eadca-5190-423d-a3c4-807f16591573 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1237 microversion: 2.1 time: 0.136715 Aug 02 09:06:47.674054 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 40/77] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:47 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1237 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:48.043861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d4accc6d-9179-4fd5-ac7e-ce578659c74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:48.045123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d4accc6d-9179-4fd5-ac7e-ce578659c74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:48.048444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:48.061334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d4accc6d-9179-4fd5-ac7e-ce578659c74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.063765 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d4accc6d-9179-4fd5-ac7e-ce578659c74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.068583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d4accc6d-9179-4fd5-ac7e-ce578659c74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.069250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d4accc6d-9179-4fd5-ac7e-ce578659c74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.278580 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:48.279421 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:48.299560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.300222 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.301029 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.301460 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.324731 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:48.405113 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:48.416571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:48.421994 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:48.423465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-794ef76d-8e54-4c23-a831-c25e509a1170 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1333 microversion: 2.20 time: 0.149427 Aug 02 09:06:48.428624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d4accc6d-9179-4fd5-ac7e-ce578659c74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:48.440298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 41/78] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:48 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1333 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:48.446901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:48.458485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d4accc6d-9179-4fd5-ac7e-ce578659c74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1274 microversion: 2.1 time: 0.431999 Aug 02 09:06:48.459611 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 38/79] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:48 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1274 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:48.638614 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-becab6ac-9500-4b10-9d27-c5d3e40c27dc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:48.639720 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-becab6ac-9500-4b10-9d27-c5d3e40c27dc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:48.647783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-becab6ac-9500-4b10-9d27-c5d3e40c27dc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.648851 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-becab6ac-9500-4b10-9d27-c5d3e40c27dc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.650167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-becab6ac-9500-4b10-9d27-c5d3e40c27dc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.650781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-becab6ac-9500-4b10-9d27-c5d3e40c27dc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.727985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-4cb15e90-826a-43fe-97d0-f26d88c2c9d4 req-3969bb6b-3463-486b-9632-d7ba7a49119f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b73e88-9298-4f0b-b36b-069907a1a076", "tag": "700a8b29-8689-4aad-9e57-8bd3ebc77848"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:48.744410 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-4cb15e90-826a-43fe-97d0-f26d88c2c9d4 req-3969bb6b-3463-486b-9632-d7ba7a49119f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.745712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-4cb15e90-826a-43fe-97d0-f26d88c2c9d4 req-3969bb6b-3463-486b-9632-d7ba7a49119f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.762971 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-becab6ac-9500-4b10-9d27-c5d3e40c27dc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:48.769712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-4cb15e90-826a-43fe-97d0-f26d88c2c9d4 req-3969bb6b-3463-486b-9632-d7ba7a49119f service nova] Creating event network-changed:700a8b29-8689-4aad-9e57-8bd3ebc77848 for instance 03b73e88-9298-4f0b-b36b-069907a1a076 on hv-cinder-84713 Aug 02 09:06:48.769826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-4cb15e90-826a-43fe-97d0-f26d88c2c9d4 req-3969bb6b-3463-486b-9632-d7ba7a49119f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 09:06:48.771113 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-33f75358-c1c2-4c66-8745-797b70664fda None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.771568 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-33f75358-c1c2-4c66-8745-797b70664fda None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.772668 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-33f75358-c1c2-4c66-8745-797b70664fda None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.773101 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-33f75358-c1c2-4c66-8745-797b70664fda None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.775099 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-becab6ac-9500-4b10-9d27-c5d3e40c27dc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1210 microversion: 2.1 time: 0.142077 Aug 02 09:06:48.776836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 39/80] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:48 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1210 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:48.782003 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e960c7d6-3b4a-4eb3-a78f-76f7dc1c0b92 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:48.782800 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e960c7d6-3b4a-4eb3-a78f-76f7dc1c0b92 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:48.789122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e960c7d6-3b4a-4eb3-a78f-76f7dc1c0b92 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.789798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e960c7d6-3b4a-4eb3-a78f-76f7dc1c0b92 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.790842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e960c7d6-3b4a-4eb3-a78f-76f7dc1c0b92 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:48.791415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e960c7d6-3b4a-4eb3-a78f-76f7dc1c0b92 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:48.798212 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.compute.rpcapi [None req-33f75358-c1c2-4c66-8745-797b70664fda None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 09:06:48.804232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-33f75358-c1c2-4c66-8745-797b70664fda None None] Releasing lock "compute-rpcapi-router" {{(pid=118368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 09:06:48.832340 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-33f75358-c1c2-4c66-8745-797b70664fda None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210588 Aug 02 09:06:48.834051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 42/81] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:48.878345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e960c7d6-3b4a-4eb3-a78f-76f7dc1c0b92 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:48.892374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e960c7d6-3b4a-4eb3-a78f-76f7dc1c0b92 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1237 microversion: 2.1 time: 0.114246 Aug 02 09:06:48.893230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 40/82] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:48 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:49.448389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:49.449690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:49.451759 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=28 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:49.458263 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.465514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.466711 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.467339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.482342 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3bf49afd-1d72-4045-8558-53fd3716f844 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:49.483691 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3bf49afd-1d72-4045-8558-53fd3716f844 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:49.490291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=26 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:49.493076 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3bf49afd-1d72-4045-8558-53fd3716f844 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.493770 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3bf49afd-1d72-4045-8558-53fd3716f844 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.495761 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3bf49afd-1d72-4045-8558-53fd3716f844 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.496585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3bf49afd-1d72-4045-8558-53fd3716f844 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.584210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:49.597007 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:49.599028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:49.600449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7cb80913-a5a0-422e-a6ef-f11b7328cdb5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1333 microversion: 2.20 time: 0.156440 Aug 02 09:06:49.601083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 43/83] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:49 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1333 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:49.636217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3bf49afd-1d72-4045-8558-53fd3716f844 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:49.647305 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3bf49afd-1d72-4045-8558-53fd3716f844 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1274 microversion: 2.1 time: 0.169600 Aug 02 09:06:49.649957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 41/84] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:49 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1274 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:49.799844 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-608dbd90-a7a1-4234-8f01-225eb4a9ddb8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:49.800533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-608dbd90-a7a1-4234-8f01-225eb4a9ddb8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:49.808999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-608dbd90-a7a1-4234-8f01-225eb4a9ddb8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.810265 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-608dbd90-a7a1-4234-8f01-225eb4a9ddb8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.811293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-608dbd90-a7a1-4234-8f01-225eb4a9ddb8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.811996 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-608dbd90-a7a1-4234-8f01-225eb4a9ddb8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.921339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-935eb4af-ff2e-4b7f-959c-633bc5b8f5d9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:49.923198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-935eb4af-ff2e-4b7f-959c-633bc5b8f5d9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:49.927307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-608dbd90-a7a1-4234-8f01-225eb4a9ddb8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:49.931696 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-935eb4af-ff2e-4b7f-959c-633bc5b8f5d9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.932401 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-935eb4af-ff2e-4b7f-959c-633bc5b8f5d9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.933910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-935eb4af-ff2e-4b7f-959c-633bc5b8f5d9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:49.935090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-935eb4af-ff2e-4b7f-959c-633bc5b8f5d9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:49.962780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-608dbd90-a7a1-4234-8f01-225eb4a9ddb8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1210 microversion: 2.1 time: 0.154950 Aug 02 09:06:49.962780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 44/85] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:49 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1210 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:50.138763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-935eb4af-ff2e-4b7f-959c-633bc5b8f5d9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:50.150156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-935eb4af-ff2e-4b7f-959c-633bc5b8f5d9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1237 microversion: 2.1 time: 0.231635 Aug 02 09:06:50.152150 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 42/86] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:49 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1237 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:50.624721 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:50.625430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:50.638818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:50.640786 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:50.641932 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:50.643763 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:50.682626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-530f0ff3-5c3d-4b3c-8263-9e74cb5cf224 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:50.684879 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-530f0ff3-5c3d-4b3c-8263-9e74cb5cf224 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:50.699218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-530f0ff3-5c3d-4b3c-8263-9e74cb5cf224 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:50.701126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-530f0ff3-5c3d-4b3c-8263-9e74cb5cf224 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:50.702840 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-530f0ff3-5c3d-4b3c-8263-9e74cb5cf224 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:50.705945 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-530f0ff3-5c3d-4b3c-8263-9e74cb5cf224 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:50.787795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:50.805461 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:50.815436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:50.828637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b7e6293d-5bf8-477a-b0ea-8169b3d56195 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1341 microversion: 2.20 time: 0.197435 Aug 02 09:06:50.834051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 45/87] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:50 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:50.887524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-530f0ff3-5c3d-4b3c-8263-9e74cb5cf224 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:50.899420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-530f0ff3-5c3d-4b3c-8263-9e74cb5cf224 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1274 microversion: 2.1 time: 0.222943 Aug 02 09:06:50.914148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 43/88] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:50 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:50.987236 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-45e677c7-db91-44dd-822e-f1d309fcdb33 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:50.989187 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-45e677c7-db91-44dd-822e-f1d309fcdb33 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:51.000723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-45e677c7-db91-44dd-822e-f1d309fcdb33 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.001192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-45e677c7-db91-44dd-822e-f1d309fcdb33 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.002586 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-45e677c7-db91-44dd-822e-f1d309fcdb33 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.003382 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-45e677c7-db91-44dd-822e-f1d309fcdb33 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.074323 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-45e677c7-db91-44dd-822e-f1d309fcdb33 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:51.082534 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-45e677c7-db91-44dd-822e-f1d309fcdb33 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1210 microversion: 2.1 time: 0.104059 Aug 02 09:06:51.083123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 46/89] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:50 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:51.174095 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e97ea0da-719c-4992-b919-8f3e387c33d3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:51.174709 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e97ea0da-719c-4992-b919-8f3e387c33d3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:51.181302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e97ea0da-719c-4992-b919-8f3e387c33d3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.181747 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e97ea0da-719c-4992-b919-8f3e387c33d3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.183166 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e97ea0da-719c-4992-b919-8f3e387c33d3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.183577 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e97ea0da-719c-4992-b919-8f3e387c33d3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.252820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e97ea0da-719c-4992-b919-8f3e387c33d3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:51.261175 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e97ea0da-719c-4992-b919-8f3e387c33d3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1237 microversion: 2.1 time: 0.091578 Aug 02 09:06:51.261825 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 44/90] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:51 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:51.844578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:51.845228 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:51.851365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.851844 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.852620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.853590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.927463 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a3e46b18-b967-4f7d-874f-d7d49871463b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:51.928807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a3e46b18-b967-4f7d-874f-d7d49871463b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:51.942602 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3e46b18-b967-4f7d-874f-d7d49871463b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.943059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3e46b18-b967-4f7d-874f-d7d49871463b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.943843 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3e46b18-b967-4f7d-874f-d7d49871463b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:51.944362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3e46b18-b967-4f7d-874f-d7d49871463b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:51.961316 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:51.978306 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:51.981190 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:51.982922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-313f471e-78b5-4f68-ae2d-188b01549eb0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1341 microversion: 2.20 time: 0.142462 Aug 02 09:06:51.985061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 47/91] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:51 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1341 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:52.031606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a3e46b18-b967-4f7d-874f-d7d49871463b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:52.039323 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a3e46b18-b967-4f7d-874f-d7d49871463b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1274 microversion: 2.1 time: 0.121585 Aug 02 09:06:52.040503 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 45/92] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:51 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:52.105122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3d5c6608-1301-4b69-b3b5-42bf7d39735a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:52.105751 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3d5c6608-1301-4b69-b3b5-42bf7d39735a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:52.113027 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d5c6608-1301-4b69-b3b5-42bf7d39735a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:52.113027 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d5c6608-1301-4b69-b3b5-42bf7d39735a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:52.113613 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d5c6608-1301-4b69-b3b5-42bf7d39735a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:52.114284 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d5c6608-1301-4b69-b3b5-42bf7d39735a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:52.180206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3d5c6608-1301-4b69-b3b5-42bf7d39735a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:52.193017 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3d5c6608-1301-4b69-b3b5-42bf7d39735a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1210 microversion: 2.1 time: 0.093005 Aug 02 09:06:52.193609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 48/93] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:52 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:52.282244 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fe3931f8-ac59-4881-a5b6-a65455285cfb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:52.282852 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fe3931f8-ac59-4881-a5b6-a65455285cfb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:52.289270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fe3931f8-ac59-4881-a5b6-a65455285cfb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:52.289708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fe3931f8-ac59-4881-a5b6-a65455285cfb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:52.290669 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fe3931f8-ac59-4881-a5b6-a65455285cfb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:52.291759 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fe3931f8-ac59-4881-a5b6-a65455285cfb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:52.365948 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fe3931f8-ac59-4881-a5b6-a65455285cfb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:52.374204 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fe3931f8-ac59-4881-a5b6-a65455285cfb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1237 microversion: 2.1 time: 0.096032 Aug 02 09:06:52.385950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 46/94] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:52 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:53.014209 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:53.014209 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:53.020951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.021410 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.022334 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.022914 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.066926 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6e777ec5-a28b-4bf1-a456-183f5800926f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:53.067553 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6e777ec5-a28b-4bf1-a456-183f5800926f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:53.087110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e777ec5-a28b-4bf1-a456-183f5800926f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.088126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e777ec5-a28b-4bf1-a456-183f5800926f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.090421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e777ec5-a28b-4bf1-a456-183f5800926f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.091392 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e777ec5-a28b-4bf1-a456-183f5800926f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.300050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:53.333152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:53.340637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:53.343821 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bf3f9535-9b5c-4ae3-ad95-be9de9cbeae1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1341 microversion: 2.20 time: 0.340046 Aug 02 09:06:53.347565 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 49/95] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:53 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1341 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:53.366764 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-71b03429-1dc9-44c2-9ba4-da5b334331b7 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:53.374474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-71b03429-1dc9-44c2-9ba4-da5b334331b7 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:53.380547 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6e777ec5-a28b-4bf1-a456-183f5800926f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:53.389312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-71b03429-1dc9-44c2-9ba4-da5b334331b7 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.397105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-71b03429-1dc9-44c2-9ba4-da5b334331b7 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.397105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-71b03429-1dc9-44c2-9ba4-da5b334331b7 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.397105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-71b03429-1dc9-44c2-9ba4-da5b334331b7 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.413724 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6e777ec5-a28b-4bf1-a456-183f5800926f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1274 microversion: 2.1 time: 0.354926 Aug 02 09:06:53.445561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 47/96] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:53 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1274 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:53.470907 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4012649c-97de-47af-8442-3d9a0c8eeade tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:53.472375 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4012649c-97de-47af-8442-3d9a0c8eeade tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:53.491281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4012649c-97de-47af-8442-3d9a0c8eeade tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.492709 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4012649c-97de-47af-8442-3d9a0c8eeade tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.499278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4012649c-97de-47af-8442-3d9a0c8eeade tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:53.500789 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4012649c-97de-47af-8442-3d9a0c8eeade tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:53.586473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-71b03429-1dc9-44c2-9ba4-da5b334331b7 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:53.601391 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-71b03429-1dc9-44c2-9ba4-da5b334331b7 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1266 microversion: 2.1 time: 0.246120 Aug 02 09:06:53.604059 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 50/97] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:53 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:53.670902 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4012649c-97de-47af-8442-3d9a0c8eeade tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:53.685551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4012649c-97de-47af-8442-3d9a0c8eeade tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1293 microversion: 2.1 time: 0.234039 Aug 02 09:06:53.688347 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 48/98] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:53 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1293 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:54.383012 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:54.383012 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:54.393166 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.393874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.394982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.395610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.460257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a084b0f7-b9fe-40da-8d43-fddfa8430927 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:54.472112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a084b0f7-b9fe-40da-8d43-fddfa8430927 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:54.472112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a084b0f7-b9fe-40da-8d43-fddfa8430927 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.472112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a084b0f7-b9fe-40da-8d43-fddfa8430927 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.472112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a084b0f7-b9fe-40da-8d43-fddfa8430927 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.472662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a084b0f7-b9fe-40da-8d43-fddfa8430927 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.546150 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:54.560920 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:54.565573 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:54.570309 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-931695e5-ec9a-44fa-b93e-fb6ead3f112a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1339 microversion: 2.20 time: 0.197821 Aug 02 09:06:54.572674 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 51/99] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:54 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1339 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:54.630046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bb7ed076-730b-41ac-97c5-0757661a9087 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:54.630848 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bb7ed076-730b-41ac-97c5-0757661a9087 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:54.633774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a084b0f7-b9fe-40da-8d43-fddfa8430927 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:54.644641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a084b0f7-b9fe-40da-8d43-fddfa8430927 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1280 microversion: 2.1 time: 0.191690 Aug 02 09:06:54.645769 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bb7ed076-730b-41ac-97c5-0757661a9087 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.646604 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bb7ed076-730b-41ac-97c5-0757661a9087 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.647724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bb7ed076-730b-41ac-97c5-0757661a9087 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.648307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bb7ed076-730b-41ac-97c5-0757661a9087 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.657737 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 49/100] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:54 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:54.715083 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0353ff2d-e200-4bd0-8578-2ff9d9cf2648 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:54.716181 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0353ff2d-e200-4bd0-8578-2ff9d9cf2648 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:54.728462 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0353ff2d-e200-4bd0-8578-2ff9d9cf2648 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.730371 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0353ff2d-e200-4bd0-8578-2ff9d9cf2648 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.731351 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0353ff2d-e200-4bd0-8578-2ff9d9cf2648 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:54.734170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0353ff2d-e200-4bd0-8578-2ff9d9cf2648 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:54.875501 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0353ff2d-e200-4bd0-8578-2ff9d9cf2648 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:54.885091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0353ff2d-e200-4bd0-8578-2ff9d9cf2648 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1301 microversion: 2.1 time: 0.174872 Aug 02 09:06:54.905306 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 50/101] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:54 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1301 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:55.003660 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bb7ed076-730b-41ac-97c5-0757661a9087 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:55.012191 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bb7ed076-730b-41ac-97c5-0757661a9087 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1274 microversion: 2.1 time: 0.387479 Aug 02 09:06:55.022322 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 52/102] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:54 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1274 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:55.600753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:55.601381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:55.609715 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:55.610209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:55.611090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:55.611646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:55.668121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c5edbd27-f833-4dc4-8182-ebff1f11043c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:55.668636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c5edbd27-f833-4dc4-8182-ebff1f11043c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:55.680547 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c5edbd27-f833-4dc4-8182-ebff1f11043c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:55.681285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c5edbd27-f833-4dc4-8182-ebff1f11043c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:55.682396 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c5edbd27-f833-4dc4-8182-ebff1f11043c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:55.683024 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c5edbd27-f833-4dc4-8182-ebff1f11043c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:55.973681 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c5edbd27-f833-4dc4-8182-ebff1f11043c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:55.977474 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:55.998351 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c5edbd27-f833-4dc4-8182-ebff1f11043c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1280 microversion: 2.1 time: 0.333963 Aug 02 09:06:56.003600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 53/103] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:55 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1280 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:06:56.021431 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-83726dd4-67b4-419d-b283-2944e1160e4f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:56.022148 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-83726dd4-67b4-419d-b283-2944e1160e4f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:56.027114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:56.030473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-83726dd4-67b4-419d-b283-2944e1160e4f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:56.031458 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-83726dd4-67b4-419d-b283-2944e1160e4f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:56.032298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:56.032489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-83726dd4-67b4-419d-b283-2944e1160e4f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:56.033093 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-83726dd4-67b4-419d-b283-2944e1160e4f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:56.033506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d91a893a-9b40-4be0-b7a3-4200571c3640 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.438676 Aug 02 09:06:56.034122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 51/104] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:55 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:56.040014 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c4d12416-54a1-40f2-a9dd-a7671eada1d3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:56.040628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c4d12416-54a1-40f2-a9dd-a7671eada1d3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:56.049090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c4d12416-54a1-40f2-a9dd-a7671eada1d3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:56.056886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c4d12416-54a1-40f2-a9dd-a7671eada1d3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:56.056886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c4d12416-54a1-40f2-a9dd-a7671eada1d3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:56.056886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c4d12416-54a1-40f2-a9dd-a7671eada1d3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:56.211695 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-83726dd4-67b4-419d-b283-2944e1160e4f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:56.225063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-83726dd4-67b4-419d-b283-2944e1160e4f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1299 microversion: 2.1 time: 0.218163 Aug 02 09:06:56.227302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 54/105] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:56 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:56.415959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c4d12416-54a1-40f2-a9dd-a7671eada1d3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:56.438721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c4d12416-54a1-40f2-a9dd-a7671eada1d3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.402323 Aug 02 09:06:56.448110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 52/106] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:56 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:57.029502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-10bde176-d50a-461f-9c57-250c4e030106 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:57.031363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-10bde176-d50a-461f-9c57-250c4e030106 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:57.054907 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10bde176-d50a-461f-9c57-250c4e030106 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.055501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10bde176-d50a-461f-9c57-250c4e030106 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.063429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10bde176-d50a-461f-9c57-250c4e030106 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.064109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10bde176-d50a-461f-9c57-250c4e030106 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.070655 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:57.071253 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:57.093496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.094143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.095895 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.096377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.428587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:57.439937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:57.442318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:57.443851 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dfc18d7b-af10-44f2-af10-7e3ce05fa6be tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.377391 Aug 02 09:06:57.445440 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 53/107] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:57 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:57.451647 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-eb69e54e-6e74-4283-8ddf-3b95df9303b3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:57.452687 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-eb69e54e-6e74-4283-8ddf-3b95df9303b3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:57.461149 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eb69e54e-6e74-4283-8ddf-3b95df9303b3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.461992 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eb69e54e-6e74-4283-8ddf-3b95df9303b3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.462991 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eb69e54e-6e74-4283-8ddf-3b95df9303b3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.464388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eb69e54e-6e74-4283-8ddf-3b95df9303b3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.585194 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-eb69e54e-6e74-4283-8ddf-3b95df9303b3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:57.595725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-eb69e54e-6e74-4283-8ddf-3b95df9303b3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1299 microversion: 2.1 time: 0.148741 Aug 02 09:06:57.596325 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 54/108] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:57 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1299 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:57.613957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d9487069-da4f-4446-a81a-cc98bbf15925 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:57.614581 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d9487069-da4f-4446-a81a-cc98bbf15925 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:57.630575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d9487069-da4f-4446-a81a-cc98bbf15925 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.631518 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d9487069-da4f-4446-a81a-cc98bbf15925 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.633287 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d9487069-da4f-4446-a81a-cc98bbf15925 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.633939 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d9487069-da4f-4446-a81a-cc98bbf15925 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.671847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:57.699053 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-10bde176-d50a-461f-9c57-250c4e030106 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:57.708447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-10bde176-d50a-461f-9c57-250c4e030106 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.683444 Aug 02 09:06:57.709861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 55/109] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:57 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:57.726131 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-70478809-56f2-47eb-9106-c04ee217eec9 req-064da0bb-d806-45c2-ae78-97918e4c4bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64dc045-cfe6-4e8f-8ead-9304350b0748", "tag": "696e0051-f163-4b40-a6e4-bab5666ab4a9"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:57.743238 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-70478809-56f2-47eb-9106-c04ee217eec9 req-064da0bb-d806-45c2-ae78-97918e4c4bc9 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:57.743759 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-70478809-56f2-47eb-9106-c04ee217eec9 req-064da0bb-d806-45c2-ae78-97918e4c4bc9 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:57.766895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-70478809-56f2-47eb-9106-c04ee217eec9 req-064da0bb-d806-45c2-ae78-97918e4c4bc9 service nova] Creating event network-changed:696e0051-f163-4b40-a6e4-bab5666ab4a9 for instance f64dc045-cfe6-4e8f-8ead-9304350b0748 on hv-cinder-84713 Aug 02 09:06:57.775434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-70478809-56f2-47eb-9106-c04ee217eec9 req-064da0bb-d806-45c2-ae78-97918e4c4bc9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063750 Aug 02 09:06:57.777195 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 56/110] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:57.842448 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d9487069-da4f-4446-a81a-cc98bbf15925 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:57.850658 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d9487069-da4f-4446-a81a-cc98bbf15925 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.250376 Aug 02 09:06:57.851250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 55/111] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:57 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:58.473670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:58.474510 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:58.495679 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.495679 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.495679 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.495679 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.691520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-02d31dfa-dd01-4fb6-93fe-d23928f8a4f4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:58.691520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-02d31dfa-dd01-4fb6-93fe-d23928f8a4f4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:58.691520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-02d31dfa-dd01-4fb6-93fe-d23928f8a4f4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.691520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-02d31dfa-dd01-4fb6-93fe-d23928f8a4f4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.693079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-02d31dfa-dd01-4fb6-93fe-d23928f8a4f4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.693079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-02d31dfa-dd01-4fb6-93fe-d23928f8a4f4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.694178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:58.702598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:58.704113 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:58.705541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-515fa4f6-e468-40bf-9b57-5bcb58e98cc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.236393 Aug 02 09:06:58.706081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 57/112] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:58 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:06:58.794581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:58.830302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-02d31dfa-dd01-4fb6-93fe-d23928f8a4f4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:58.839011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-02d31dfa-dd01-4fb6-93fe-d23928f8a4f4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.225417 Aug 02 09:06:58.841599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 56/113] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:58 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:58.847209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5e5c3025-e056-42a1-bcc8-c68cebfe441c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:58.848087 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5e5c3025-e056-42a1-bcc8-c68cebfe441c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:58.850026 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-b6ee6f4e-a1ed-4a9a-b203-07d21ce6dd0e req-1a082e89-0dc9-4c57-9180-b16416d9030f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c248147-71ed-4f5f-89cc-8ca12974efb4", "tag": "27491509-00ef-451e-b2ac-f08e653e8310"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:06:58.856141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5e5c3025-e056-42a1-bcc8-c68cebfe441c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.856781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5e5c3025-e056-42a1-bcc8-c68cebfe441c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.857784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5e5c3025-e056-42a1-bcc8-c68cebfe441c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.858399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5e5c3025-e056-42a1-bcc8-c68cebfe441c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.867428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-b6ee6f4e-a1ed-4a9a-b203-07d21ce6dd0e req-1a082e89-0dc9-4c57-9180-b16416d9030f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.871876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-b6ee6f4e-a1ed-4a9a-b203-07d21ce6dd0e req-1a082e89-0dc9-4c57-9180-b16416d9030f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.890588 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-b6ee6f4e-a1ed-4a9a-b203-07d21ce6dd0e req-1a082e89-0dc9-4c57-9180-b16416d9030f service nova] Creating event network-changed:27491509-00ef-451e-b2ac-f08e653e8310 for instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 on hv-cinder-84713 Aug 02 09:06:58.898894 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-b6ee6f4e-a1ed-4a9a-b203-07d21ce6dd0e req-1a082e89-0dc9-4c57-9180-b16416d9030f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191139 Aug 02 09:06:58.899862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 58/114] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:06:58.907296 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c261e62b-7aae-4990-aa03-671bd82c3120 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:58.908032 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c261e62b-7aae-4990-aa03-671bd82c3120 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:58.921449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c261e62b-7aae-4990-aa03-671bd82c3120 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.921449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c261e62b-7aae-4990-aa03-671bd82c3120 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:58.921449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c261e62b-7aae-4990-aa03-671bd82c3120 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:58.921449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c261e62b-7aae-4990-aa03-671bd82c3120 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:59.090457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5e5c3025-e056-42a1-bcc8-c68cebfe441c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:59.099281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5e5c3025-e056-42a1-bcc8-c68cebfe441c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.256088 Aug 02 09:06:59.100237 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 57/115] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:58 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:59.731014 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:59.731945 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:59.738950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:59.740218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:59.741230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:59.742666 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:59.783294 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c261e62b-7aae-4990-aa03-671bd82c3120 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:06:59.796102 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:59.810122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c261e62b-7aae-4990-aa03-671bd82c3120 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.907105 Aug 02 09:06:59.815759 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 59/116] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:58 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:06:59.864366 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b7ef954a-657f-4c9e-9eb4-ae7714cc728e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:06:59.867838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b7ef954a-657f-4c9e-9eb4-ae7714cc728e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:06:59.880381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7ef954a-657f-4c9e-9eb4-ae7714cc728e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:59.884870 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7ef954a-657f-4c9e-9eb4-ae7714cc728e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:06:59.886114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7ef954a-657f-4c9e-9eb4-ae7714cc728e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:06:59.887152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7ef954a-657f-4c9e-9eb4-ae7714cc728e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:00.126601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:00.135970 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:00.139760 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:00.147354 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4838ed0a-aa1e-4092-afa2-8e647f968431 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.419698 Aug 02 09:07:00.172942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 58/117] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:06:59 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:07:00.195306 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4989ced7-6f50-4e4d-b221-430153705b6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:00.197273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4989ced7-6f50-4e4d-b221-430153705b6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:00.216986 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4989ced7-6f50-4e4d-b221-430153705b6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:00.219308 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4989ced7-6f50-4e4d-b221-430153705b6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:00.222067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4989ced7-6f50-4e4d-b221-430153705b6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:00.224808 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4989ced7-6f50-4e4d-b221-430153705b6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:00.447810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b7ef954a-657f-4c9e-9eb4-ae7714cc728e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:00.469448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b7ef954a-657f-4c9e-9eb4-ae7714cc728e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.609751 Aug 02 09:07:00.469993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 60/118] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:06:59 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:00.637231 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4989ced7-6f50-4e4d-b221-430153705b6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:00.645699 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4989ced7-6f50-4e4d-b221-430153705b6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.469869 Aug 02 09:07:00.648614 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 59/119] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:00 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:00.851262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-22814a5c-7303-455d-8885-4f22b092ce30 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:00.852153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-22814a5c-7303-455d-8885-4f22b092ce30 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:00.862806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-22814a5c-7303-455d-8885-4f22b092ce30 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:00.863579 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-22814a5c-7303-455d-8885-4f22b092ce30 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:00.868710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-22814a5c-7303-455d-8885-4f22b092ce30 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:00.868710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-22814a5c-7303-455d-8885-4f22b092ce30 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.193459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:01.194115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:01.206427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.206886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.207676 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.208249 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.216089 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-22814a5c-7303-455d-8885-4f22b092ce30 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:01.227423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-22814a5c-7303-455d-8885-4f22b092ce30 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.380261 Aug 02 09:07:01.241916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 61/120] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:00 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:01.341268 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-154b8c25-d8a0-471e-a088-83e7fea54097 req-eb0da4a6-cd0d-4497-99e5-0aba340e9d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc22a12f-291a-4c23-add9-09a32ae7202e", "tag": "9c3cf01f-81d0-4a72-b4fb-cf0e71bc6406"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:01.354977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-154b8c25-d8a0-471e-a088-83e7fea54097 req-eb0da4a6-cd0d-4497-99e5-0aba340e9d6b service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.355806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-154b8c25-d8a0-471e-a088-83e7fea54097 req-eb0da4a6-cd0d-4497-99e5-0aba340e9d6b service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.384348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-154b8c25-d8a0-471e-a088-83e7fea54097 req-eb0da4a6-cd0d-4497-99e5-0aba340e9d6b service nova] Creating event network-changed:9c3cf01f-81d0-4a72-b4fb-cf0e71bc6406 for instance dc22a12f-291a-4c23-add9-09a32ae7202e on hv-cinder-84713 Aug 02 09:07:01.391976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-154b8c25-d8a0-471e-a088-83e7fea54097 req-eb0da4a6-cd0d-4497-99e5-0aba340e9d6b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056673 Aug 02 09:07:01.393225 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 62/121] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:07:01.430250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:01.441073 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:01.444033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:01.445180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-609fb4b3-adc7-4f73-af76-6100d9961601 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.255847 Aug 02 09:07:01.445979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 60/122] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:01 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:07:01.491268 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a15713a2-2d7a-48ea-94e1-58566ef27cb8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:01.492056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a15713a2-2d7a-48ea-94e1-58566ef27cb8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:01.500268 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a15713a2-2d7a-48ea-94e1-58566ef27cb8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.500816 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a15713a2-2d7a-48ea-94e1-58566ef27cb8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.501844 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a15713a2-2d7a-48ea-94e1-58566ef27cb8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.502319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a15713a2-2d7a-48ea-94e1-58566ef27cb8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.679771 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a15713a2-2d7a-48ea-94e1-58566ef27cb8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:01.692399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2d324139-86da-460f-bd55-f9b86121048a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:01.693104 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2d324139-86da-460f-bd55-f9b86121048a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:01.703486 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d324139-86da-460f-bd55-f9b86121048a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.704283 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d324139-86da-460f-bd55-f9b86121048a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.705921 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d324139-86da-460f-bd55-f9b86121048a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:01.706932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d324139-86da-460f-bd55-f9b86121048a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:01.707973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a15713a2-2d7a-48ea-94e1-58566ef27cb8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.220635 Aug 02 09:07:01.712319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 63/123] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:01 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:02.008631 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2d324139-86da-460f-bd55-f9b86121048a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:02.019499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2d324139-86da-460f-bd55-f9b86121048a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.336464 Aug 02 09:07:02.020098 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 61/124] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:01 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:02.256118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-39f1b1a4-f786-4bb0-b53c-d3f3244ba254 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:02.256118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-39f1b1a4-f786-4bb0-b53c-d3f3244ba254 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:02.262828 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39f1b1a4-f786-4bb0-b53c-d3f3244ba254 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:02.263564 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39f1b1a4-f786-4bb0-b53c-d3f3244ba254 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:02.264492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39f1b1a4-f786-4bb0-b53c-d3f3244ba254 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:02.265070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39f1b1a4-f786-4bb0-b53c-d3f3244ba254 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:02.447266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-39f1b1a4-f786-4bb0-b53c-d3f3244ba254 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:02.455772 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-39f1b1a4-f786-4bb0-b53c-d3f3244ba254 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.204268 Aug 02 09:07:02.456336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 64/125] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:02 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:02.468583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:02.469231 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:02.475629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:02.476083 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:02.476881 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:02.477324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:02.684551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:02.697494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:02.697494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:02.698808 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0995f398-c944-43ad-8be5-41fd43737dc8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.232825 Aug 02 09:07:02.699141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 62/126] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:02 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:02.752962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-152d734f-f39f-4a80-bd49-531d65ad6a2a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:02.754810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-152d734f-f39f-4a80-bd49-531d65ad6a2a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:02.760871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-152d734f-f39f-4a80-bd49-531d65ad6a2a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:02.761321 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-152d734f-f39f-4a80-bd49-531d65ad6a2a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:02.762127 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-152d734f-f39f-4a80-bd49-531d65ad6a2a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:02.762657 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-152d734f-f39f-4a80-bd49-531d65ad6a2a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:02.938843 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-152d734f-f39f-4a80-bd49-531d65ad6a2a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:02.949402 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-152d734f-f39f-4a80-bd49-531d65ad6a2a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.200518 Aug 02 09:07:02.950117 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 65/127] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:02 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:03.044529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-859be92f-3d09-4c68-81cb-477742b530cc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:03.045976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-859be92f-3d09-4c68-81cb-477742b530cc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:03.052800 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-859be92f-3d09-4c68-81cb-477742b530cc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.053405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-859be92f-3d09-4c68-81cb-477742b530cc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.054400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-859be92f-3d09-4c68-81cb-477742b530cc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.054844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-859be92f-3d09-4c68-81cb-477742b530cc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.245554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-859be92f-3d09-4c68-81cb-477742b530cc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:03.255035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-859be92f-3d09-4c68-81cb-477742b530cc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.216481 Aug 02 09:07:03.255859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 63/128] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:03 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:03.415115 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-89cb8884-3c96-4a7c-bd27-a1ddf32eb5c3 req-6262f0e3-59ba-4475-b2b1-6fc1dd86b882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b281103-e2e9-4a29-93a6-80ef8943841a", "tag": "9239d9b4-016e-4388-8e77-96d7b816177a"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:03.429412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-89cb8884-3c96-4a7c-bd27-a1ddf32eb5c3 req-6262f0e3-59ba-4475-b2b1-6fc1dd86b882 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.430557 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-89cb8884-3c96-4a7c-bd27-a1ddf32eb5c3 req-6262f0e3-59ba-4475-b2b1-6fc1dd86b882 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.450241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-89cb8884-3c96-4a7c-bd27-a1ddf32eb5c3 req-6262f0e3-59ba-4475-b2b1-6fc1dd86b882 service nova] Creating event network-changed:9239d9b4-016e-4388-8e77-96d7b816177a for instance 6b281103-e2e9-4a29-93a6-80ef8943841a on hv-cinder-84713 Aug 02 09:07:03.458078 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-89cb8884-3c96-4a7c-bd27-a1ddf32eb5c3 req-6262f0e3-59ba-4475-b2b1-6fc1dd86b882 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047197 Aug 02 09:07:03.459551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 66/129] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:03.477282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4d39802c-b9b7-46f7-8d97-642952fba98f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:03.479164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4d39802c-b9b7-46f7-8d97-642952fba98f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:03.489570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4d39802c-b9b7-46f7-8d97-642952fba98f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.490370 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4d39802c-b9b7-46f7-8d97-642952fba98f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.491314 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4d39802c-b9b7-46f7-8d97-642952fba98f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.491974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4d39802c-b9b7-46f7-8d97-642952fba98f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.712911 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-61f239d5-330e-49ee-a13f-ab01346196a8 req-95ba99f3-a15c-4b31-b0c6-bff4445e9c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b73e88-9298-4f0b-b36b-069907a1a076", "name": "network-vif-plugged", "status": "completed", "tag": "700a8b29-8689-4aad-9e57-8bd3ebc77848"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:03.720181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-61f239d5-330e-49ee-a13f-ab01346196a8 req-95ba99f3-a15c-4b31-b0c6-bff4445e9c10 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.720691 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-61f239d5-330e-49ee-a13f-ab01346196a8 req-95ba99f3-a15c-4b31-b0c6-bff4445e9c10 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.730713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4d39802c-b9b7-46f7-8d97-642952fba98f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:03.743539 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-61f239d5-330e-49ee-a13f-ab01346196a8 req-95ba99f3-a15c-4b31-b0c6-bff4445e9c10 service nova] Creating event network-vif-plugged:700a8b29-8689-4aad-9e57-8bd3ebc77848 for instance 03b73e88-9298-4f0b-b36b-069907a1a076 on hv-cinder-84713 Aug 02 09:07:03.751743 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4d39802c-b9b7-46f7-8d97-642952fba98f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.278478 Aug 02 09:07:03.753123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 64/130] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:03 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:03.753277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-61f239d5-330e-49ee-a13f-ab01346196a8 req-95ba99f3-a15c-4b31-b0c6-bff4445e9c10 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133088 Aug 02 09:07:03.754902 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 67/131] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:07:03.759141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:03.760480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:03.767909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.768589 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.769861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.770494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.921105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:03.935093 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:03.937168 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:03.938643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b590b1cc-f1b4-4cdd-a8eb-6e0c5866aaa1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.184141 Aug 02 09:07:03.939314 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 65/132] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:03 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:03.971597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f3298053-a4cd-4589-b89b-071d7c5c9379 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:03.972302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f3298053-a4cd-4589-b89b-071d7c5c9379 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:03.979245 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3298053-a4cd-4589-b89b-071d7c5c9379 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.979985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3298053-a4cd-4589-b89b-071d7c5c9379 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:03.980165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3298053-a4cd-4589-b89b-071d7c5c9379 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:03.980595 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3298053-a4cd-4589-b89b-071d7c5c9379 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:04.120431 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f3298053-a4cd-4589-b89b-071d7c5c9379 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:04.128202 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f3298053-a4cd-4589-b89b-071d7c5c9379 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.161443 Aug 02 09:07:04.128782 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 68/133] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:03 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:04.277609 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0cac21a3-0f6a-488b-97e8-1511b738154e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:04.278528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0cac21a3-0f6a-488b-97e8-1511b738154e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:04.286176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0cac21a3-0f6a-488b-97e8-1511b738154e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:04.286702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0cac21a3-0f6a-488b-97e8-1511b738154e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:04.287604 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0cac21a3-0f6a-488b-97e8-1511b738154e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:04.288058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0cac21a3-0f6a-488b-97e8-1511b738154e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:04.437097 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0cac21a3-0f6a-488b-97e8-1511b738154e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:04.447469 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0cac21a3-0f6a-488b-97e8-1511b738154e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.174864 Aug 02 09:07:04.448306 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 66/134] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:04 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:04.780516 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-32b88027-c8ec-4d61-9899-e8a28dade0a0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:04.781130 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-32b88027-c8ec-4d61-9899-e8a28dade0a0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:04.788189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-32b88027-c8ec-4d61-9899-e8a28dade0a0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:04.790877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-32b88027-c8ec-4d61-9899-e8a28dade0a0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:04.790877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-32b88027-c8ec-4d61-9899-e8a28dade0a0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:04.790877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-32b88027-c8ec-4d61-9899-e8a28dade0a0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:04.942110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-32b88027-c8ec-4d61-9899-e8a28dade0a0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:04.950628 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-32b88027-c8ec-4d61-9899-e8a28dade0a0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.173728 Aug 02 09:07:04.951136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 69/135] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:04 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:04.962633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:04.967255 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:04.973694 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:04.974186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:04.974972 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:04.975414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.129453 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:05.137513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:05.139102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:05.140250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4958ed30-da3c-46a5-af37-94da8c6904a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.181531 Aug 02 09:07:05.140823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 67/136] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:04 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:05.155520 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-42ec73ad-58d5-4b19-a579-db379ce0d097 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:05.156235 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-42ec73ad-58d5-4b19-a579-db379ce0d097 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:05.163238 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-42ec73ad-58d5-4b19-a579-db379ce0d097 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.163666 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-42ec73ad-58d5-4b19-a579-db379ce0d097 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.164518 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-42ec73ad-58d5-4b19-a579-db379ce0d097 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.164940 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-42ec73ad-58d5-4b19-a579-db379ce0d097 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.315781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-42ec73ad-58d5-4b19-a579-db379ce0d097 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:05.324585 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-42ec73ad-58d5-4b19-a579-db379ce0d097 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.178663 Aug 02 09:07:05.325181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 70/137] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:05 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:05.473043 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-18adde00-2379-4e5c-8686-b8baf1135290 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:05.474271 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-18adde00-2379-4e5c-8686-b8baf1135290 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:05.496331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18adde00-2379-4e5c-8686-b8baf1135290 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.497143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18adde00-2379-4e5c-8686-b8baf1135290 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.498226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18adde00-2379-4e5c-8686-b8baf1135290 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.499316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18adde00-2379-4e5c-8686-b8baf1135290 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.811456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-18adde00-2379-4e5c-8686-b8baf1135290 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:05.822457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-18adde00-2379-4e5c-8686-b8baf1135290 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.354765 Aug 02 09:07:05.824722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 68/138] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:05 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:05.974612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-efd9e9e7-111b-423c-9bfa-d9008994f2f3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:05.976123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-efd9e9e7-111b-423c-9bfa-d9008994f2f3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:05.987681 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-efd9e9e7-111b-423c-9bfa-d9008994f2f3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.988981 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-efd9e9e7-111b-423c-9bfa-d9008994f2f3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:05.990667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-efd9e9e7-111b-423c-9bfa-d9008994f2f3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:05.993916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-efd9e9e7-111b-423c-9bfa-d9008994f2f3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:06.169524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:06.171507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:06.182979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:06.190139 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:06.191532 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:06.192082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:06.372083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-efd9e9e7-111b-423c-9bfa-d9008994f2f3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:06.380587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-efd9e9e7-111b-423c-9bfa-d9008994f2f3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.409924 Aug 02 09:07:06.381354 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 71/139] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:05 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:06.389188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-943f2aa8-1e36-4b9b-975e-b80229d0539d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:06.392399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-943f2aa8-1e36-4b9b-975e-b80229d0539d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:06.399907 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-943f2aa8-1e36-4b9b-975e-b80229d0539d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:06.401425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-943f2aa8-1e36-4b9b-975e-b80229d0539d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:06.402890 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-943f2aa8-1e36-4b9b-975e-b80229d0539d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:06.403861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-943f2aa8-1e36-4b9b-975e-b80229d0539d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:06.504458 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:06.514582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:06.516943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:06.518228 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e4c6e5d3-4ab1-4652-8fbf-306c5d12da54 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.357161 Aug 02 09:07:06.518884 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 69/140] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:06 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:07:06.720662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-943f2aa8-1e36-4b9b-975e-b80229d0539d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:06.733068 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-943f2aa8-1e36-4b9b-975e-b80229d0539d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.350153 Aug 02 09:07:06.755595 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 72/141] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:06 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:06.845727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1900bf72-af74-4714-82ec-10b421fc0fa2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:06.850113 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1900bf72-af74-4714-82ec-10b421fc0fa2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:06.858836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1900bf72-af74-4714-82ec-10b421fc0fa2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:06.860406 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1900bf72-af74-4714-82ec-10b421fc0fa2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:06.863455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1900bf72-af74-4714-82ec-10b421fc0fa2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:06.864229 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1900bf72-af74-4714-82ec-10b421fc0fa2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.313775 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1900bf72-af74-4714-82ec-10b421fc0fa2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:07.333852 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1900bf72-af74-4714-82ec-10b421fc0fa2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.491573 Aug 02 09:07:07.338278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 70/142] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:06 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:07.406392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-b9148537-893d-4b7f-8e00-a4eff85cf014 req-5e30a14f-c1dd-48a6-8354-ec5d6ca4f750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c248147-71ed-4f5f-89cc-8ca12974efb4", "name": "network-vif-plugged", "status": "completed", "tag": "27491509-00ef-451e-b2ac-f08e653e8310"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:07.411771 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0713a1f5-20e1-4d7b-ab44-d094faf5318f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:07.413866 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0713a1f5-20e1-4d7b-ab44-d094faf5318f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:07.435417 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0713a1f5-20e1-4d7b-ab44-d094faf5318f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.435877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0713a1f5-20e1-4d7b-ab44-d094faf5318f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.436561 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-b9148537-893d-4b7f-8e00-a4eff85cf014 req-5e30a14f-c1dd-48a6-8354-ec5d6ca4f750 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.439622 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-b9148537-893d-4b7f-8e00-a4eff85cf014 req-5e30a14f-c1dd-48a6-8354-ec5d6ca4f750 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.440222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0713a1f5-20e1-4d7b-ab44-d094faf5318f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.442507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0713a1f5-20e1-4d7b-ab44-d094faf5318f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.477715 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-b9148537-893d-4b7f-8e00-a4eff85cf014 req-5e30a14f-c1dd-48a6-8354-ec5d6ca4f750 service nova] Creating event network-vif-plugged:27491509-00ef-451e-b2ac-f08e653e8310 for instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 on hv-cinder-84713 Aug 02 09:07:07.490562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-b9148537-893d-4b7f-8e00-a4eff85cf014 req-5e30a14f-c1dd-48a6-8354-ec5d6ca4f750 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088205 Aug 02 09:07:07.493851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 73/143] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:07:07.545932 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:07.547059 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:07.569098 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.569596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.570505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.574040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.721091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0713a1f5-20e1-4d7b-ab44-d094faf5318f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:07.737372 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0713a1f5-20e1-4d7b-ab44-d094faf5318f tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.333591 Aug 02 09:07:07.742090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 71/144] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:07 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:07.774365 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-40a0e200-16e5-4b84-9a68-abf5e34f3ae0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:07.775425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-40a0e200-16e5-4b84-9a68-abf5e34f3ae0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:07.796023 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-40a0e200-16e5-4b84-9a68-abf5e34f3ae0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.796767 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-40a0e200-16e5-4b84-9a68-abf5e34f3ae0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.798086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-40a0e200-16e5-4b84-9a68-abf5e34f3ae0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:07.799070 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-40a0e200-16e5-4b84-9a68-abf5e34f3ae0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:07.840065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:07.849819 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:07.863272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:07.865357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:07.866872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3296f316-ff06-48ef-b637-aa706ec86415 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.328018 Aug 02 09:07:07.867873 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 74/145] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:07 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:07.998879 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-40a0e200-16e5-4b84-9a68-abf5e34f3ae0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:08.010189 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-40a0e200-16e5-4b84-9a68-abf5e34f3ae0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.245623 Aug 02 09:07:08.011287 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 72/146] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:07 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:08.358282 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-745724eb-d5a2-4eff-88cb-ecf67d992d88 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:08.358897 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-745724eb-d5a2-4eff-88cb-ecf67d992d88 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:08.369125 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-745724eb-d5a2-4eff-88cb-ecf67d992d88 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:08.369826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-745724eb-d5a2-4eff-88cb-ecf67d992d88 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:08.370815 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-745724eb-d5a2-4eff-88cb-ecf67d992d88 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:08.371371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-745724eb-d5a2-4eff-88cb-ecf67d992d88 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:08.581974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-745724eb-d5a2-4eff-88cb-ecf67d992d88 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:08.584274 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-745724eb-d5a2-4eff-88cb-ecf67d992d88 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.229648 Aug 02 09:07:08.585053 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 75/147] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:08 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:08.766353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1336c3c8-5926-436f-b9ae-2d7d80f75997 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:08.767230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1336c3c8-5926-436f-b9ae-2d7d80f75997 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:08.776654 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1336c3c8-5926-436f-b9ae-2d7d80f75997 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:08.777507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1336c3c8-5926-436f-b9ae-2d7d80f75997 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:08.778605 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1336c3c8-5926-436f-b9ae-2d7d80f75997 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:08.779231 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1336c3c8-5926-436f-b9ae-2d7d80f75997 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:08.890653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:08.891143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:08.897561 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:08.898079 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:08.898868 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:08.899290 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:08.944060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1336c3c8-5926-436f-b9ae-2d7d80f75997 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:08.961506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1336c3c8-5926-436f-b9ae-2d7d80f75997 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.201316 Aug 02 09:07:08.976116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 73/148] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:08 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:09.040770 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d606c799-c122-48e1-9d32-c13bcb96ce08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:09.041597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d606c799-c122-48e1-9d32-c13bcb96ce08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:09.048379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d606c799-c122-48e1-9d32-c13bcb96ce08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.048831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d606c799-c122-48e1-9d32-c13bcb96ce08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.049795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d606c799-c122-48e1-9d32-c13bcb96ce08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.050266 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d606c799-c122-48e1-9d32-c13bcb96ce08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.098700 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:09.118210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:09.118210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:09.119677 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c77bc8bb-e419-48c7-887d-fb74645e73fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.233008 Aug 02 09:07:09.123074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 76/149] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:08 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:07:09.303628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d606c799-c122-48e1-9d32-c13bcb96ce08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:09.313823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d606c799-c122-48e1-9d32-c13bcb96ce08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.277416 Aug 02 09:07:09.323995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 74/150] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:09 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:09.523425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-4057f704-0a8d-4fde-ad60-49ffbe225f24 req-ac58cddd-c59e-4dca-bfa9-9f6fcfba4f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64dc045-cfe6-4e8f-8ead-9304350b0748", "name": "network-vif-plugged", "status": "completed", "tag": "696e0051-f163-4b40-a6e4-bab5666ab4a9"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:09.533534 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-4057f704-0a8d-4fde-ad60-49ffbe225f24 req-ac58cddd-c59e-4dca-bfa9-9f6fcfba4f50 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.534186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-4057f704-0a8d-4fde-ad60-49ffbe225f24 req-ac58cddd-c59e-4dca-bfa9-9f6fcfba4f50 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.548942 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-4057f704-0a8d-4fde-ad60-49ffbe225f24 req-ac58cddd-c59e-4dca-bfa9-9f6fcfba4f50 service nova] Creating event network-vif-plugged:696e0051-f163-4b40-a6e4-bab5666ab4a9 for instance f64dc045-cfe6-4e8f-8ead-9304350b0748 on hv-cinder-84713 Aug 02 09:07:09.554454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-4057f704-0a8d-4fde-ad60-49ffbe225f24 req-ac58cddd-c59e-4dca-bfa9-9f6fcfba4f50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037486 Aug 02 09:07:09.557286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 77/151] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:09.605698 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f6616781-0ab1-4c47-bde7-f93b58a54fef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:09.606535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f6616781-0ab1-4c47-bde7-f93b58a54fef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:09.613596 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f6616781-0ab1-4c47-bde7-f93b58a54fef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.615247 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f6616781-0ab1-4c47-bde7-f93b58a54fef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.615247 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f6616781-0ab1-4c47-bde7-f93b58a54fef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:09.615668 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f6616781-0ab1-4c47-bde7-f93b58a54fef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:09.769989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f6616781-0ab1-4c47-bde7-f93b58a54fef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:09.783242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f6616781-0ab1-4c47-bde7-f93b58a54fef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.181612 Aug 02 09:07:09.784105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 75/152] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:09 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:09.996216 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-20116ecf-26d7-4ff2-a438-97e243ac1656 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:09.996216 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-20116ecf-26d7-4ff2-a438-97e243ac1656 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:10.001116 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-20116ecf-26d7-4ff2-a438-97e243ac1656 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.002647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-20116ecf-26d7-4ff2-a438-97e243ac1656 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.003906 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-20116ecf-26d7-4ff2-a438-97e243ac1656 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.004872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-20116ecf-26d7-4ff2-a438-97e243ac1656 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.163395 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:10.164005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:10.173910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.174820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.175616 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.176674 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.194016 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-20116ecf-26d7-4ff2-a438-97e243ac1656 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:10.201692 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-20116ecf-26d7-4ff2-a438-97e243ac1656 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.221155 Aug 02 09:07:10.203274 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 78/153] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:09 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:10.342473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-55887a4e-446f-4d40-92eb-2a1ba9aa836d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:10.343578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-55887a4e-446f-4d40-92eb-2a1ba9aa836d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:10.348413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:10.352534 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-55887a4e-446f-4d40-92eb-2a1ba9aa836d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.353208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-55887a4e-446f-4d40-92eb-2a1ba9aa836d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.354361 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-55887a4e-446f-4d40-92eb-2a1ba9aa836d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.355089 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-55887a4e-446f-4d40-92eb-2a1ba9aa836d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.357495 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:10.359156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:10.360534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c8aba549-1133-4055-a5c4-3c1b7ede3d35 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.203044 Aug 02 09:07:10.361176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 76/154] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:10 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:07:10.547796 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-55887a4e-446f-4d40-92eb-2a1ba9aa836d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:10.551574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:10.556318 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-55887a4e-446f-4d40-92eb-2a1ba9aa836d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.222074 Aug 02 09:07:10.557825 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 79/155] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:10 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:10.808020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-66f6c5c8-4027-4062-beaa-65e84af99340 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:10.809219 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-66f6c5c8-4027-4062-beaa-65e84af99340 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:10.817292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-66f6c5c8-4027-4062-beaa-65e84af99340 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.818080 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-66f6c5c8-4027-4062-beaa-65e84af99340 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:10.819378 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-66f6c5c8-4027-4062-beaa-65e84af99340 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:10.820596 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-66f6c5c8-4027-4062-beaa-65e84af99340 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.029435 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-66f6c5c8-4027-4062-beaa-65e84af99340 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:11.046413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-66f6c5c8-4027-4062-beaa-65e84af99340 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.244822 Aug 02 09:07:11.054262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 77/156] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:10 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:11.227520 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-567bcc97-77d7-4991-8ee9-028d97144d54 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:11.228986 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-567bcc97-77d7-4991-8ee9-028d97144d54 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:11.241856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-567bcc97-77d7-4991-8ee9-028d97144d54 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:11.241856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-567bcc97-77d7-4991-8ee9-028d97144d54 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.241856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-567bcc97-77d7-4991-8ee9-028d97144d54 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:11.241856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-567bcc97-77d7-4991-8ee9-028d97144d54 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.396606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:11.397957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:11.412421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:11.413353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.415344 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:11.416202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.417565 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-567bcc97-77d7-4991-8ee9-028d97144d54 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:11.431096 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-567bcc97-77d7-4991-8ee9-028d97144d54 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.209500 Aug 02 09:07:11.435655 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 80/157] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:11 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:11.581071 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-72c33fa7-7546-4929-bb26-c52c597a0a1a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:11.582201 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-72c33fa7-7546-4929-bb26-c52c597a0a1a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:11.593188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72c33fa7-7546-4929-bb26-c52c597a0a1a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:11.594055 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72c33fa7-7546-4929-bb26-c52c597a0a1a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.595591 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72c33fa7-7546-4929-bb26-c52c597a0a1a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:11.596596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72c33fa7-7546-4929-bb26-c52c597a0a1a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:11.600888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:11.610061 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:11.611574 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:11.612734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d89c075f-6e7e-4b4b-875f-a93718945817 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.224135 Aug 02 09:07:11.613300 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 78/158] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:11 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:11.789137 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-72c33fa7-7546-4929-bb26-c52c597a0a1a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:11.797408 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-72c33fa7-7546-4929-bb26-c52c597a0a1a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.221737 Aug 02 09:07:11.798327 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 81/159] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:11 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:12.068781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f7d1f83d-09da-4c43-a573-833fe2b1f283 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:12.069388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f7d1f83d-09da-4c43-a573-833fe2b1f283 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:12.075826 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f7d1f83d-09da-4c43-a573-833fe2b1f283 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.076273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f7d1f83d-09da-4c43-a573-833fe2b1f283 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.077349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f7d1f83d-09da-4c43-a573-833fe2b1f283 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.077817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f7d1f83d-09da-4c43-a573-833fe2b1f283 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.230656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f7d1f83d-09da-4c43-a573-833fe2b1f283 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:12.239112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f7d1f83d-09da-4c43-a573-833fe2b1f283 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.174210 Aug 02 09:07:12.239692 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 79/160] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:12 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:12.452627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ec94a437-9b33-45e6-aa3d-f7919dcd780c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:12.453229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ec94a437-9b33-45e6-aa3d-f7919dcd780c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:12.459779 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ec94a437-9b33-45e6-aa3d-f7919dcd780c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.462504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ec94a437-9b33-45e6-aa3d-f7919dcd780c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.462504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ec94a437-9b33-45e6-aa3d-f7919dcd780c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.462504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ec94a437-9b33-45e6-aa3d-f7919dcd780c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.602576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ec94a437-9b33-45e6-aa3d-f7919dcd780c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:12.611234 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ec94a437-9b33-45e6-aa3d-f7919dcd780c tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.162306 Aug 02 09:07:12.612050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 82/161] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:12 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:12.640569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:12.641405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:12.649164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.649633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.651542 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.652248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.813667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:12.822837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-08148681-7c69-415e-9ec2-a9f31960743e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:12.823742 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-08148681-7c69-415e-9ec2-a9f31960743e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:12.825605 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:12.828032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:12.830418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-39d8d697-ebdc-4706-8017-592240e458b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.194115 Aug 02 09:07:12.831549 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 80/162] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:12 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:07:12.831666 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08148681-7c69-415e-9ec2-a9f31960743e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.832169 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08148681-7c69-415e-9ec2-a9f31960743e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.833090 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08148681-7c69-415e-9ec2-a9f31960743e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:12.833555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08148681-7c69-415e-9ec2-a9f31960743e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:12.973396 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-08148681-7c69-415e-9ec2-a9f31960743e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:12.982331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-08148681-7c69-415e-9ec2-a9f31960743e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.165077 Aug 02 09:07:12.982901 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 83/163] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:12 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:13.261596 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9f708dbe-bbce-411e-a25f-06a9e7304aae tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:13.262999 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9f708dbe-bbce-411e-a25f-06a9e7304aae tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:13.270016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9f708dbe-bbce-411e-a25f-06a9e7304aae tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:13.270958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9f708dbe-bbce-411e-a25f-06a9e7304aae tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:13.271915 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9f708dbe-bbce-411e-a25f-06a9e7304aae tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:13.272567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9f708dbe-bbce-411e-a25f-06a9e7304aae tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:13.430461 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9f708dbe-bbce-411e-a25f-06a9e7304aae tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:13.439182 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9f708dbe-bbce-411e-a25f-06a9e7304aae tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.182376 Aug 02 09:07:13.439760 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 81/164] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:13 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:13.635473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4c956dcc-dfb5-4d08-951f-790b37b36ea0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:13.636080 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4c956dcc-dfb5-4d08-951f-790b37b36ea0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:13.644385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c956dcc-dfb5-4d08-951f-790b37b36ea0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:13.646804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c956dcc-dfb5-4d08-951f-790b37b36ea0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:13.646804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c956dcc-dfb5-4d08-951f-790b37b36ea0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:13.646804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c956dcc-dfb5-4d08-951f-790b37b36ea0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:13.809762 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4c956dcc-dfb5-4d08-951f-790b37b36ea0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:13.841120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4c956dcc-dfb5-4d08-951f-790b37b36ea0 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.210563 Aug 02 09:07:13.842261 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 84/165] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:13 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:13.881385 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:13.882583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:13.895629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:13.897593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:13.899671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:13.900648 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.006861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1edf1bce-3e4a-49ee-bdd0-a19437f9d17d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:14.010389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1edf1bce-3e4a-49ee-bdd0-a19437f9d17d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:14.016211 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1edf1bce-3e4a-49ee-bdd0-a19437f9d17d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.016776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1edf1bce-3e4a-49ee-bdd0-a19437f9d17d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.019875 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1edf1bce-3e4a-49ee-bdd0-a19437f9d17d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.020406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1edf1bce-3e4a-49ee-bdd0-a19437f9d17d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.138026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:14.151757 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:14.155226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:14.157266 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-15a20a17-80af-4ceb-b63a-13b6502e3bc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.297061 Aug 02 09:07:14.158685 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 82/166] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:13 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:14.198153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1edf1bce-3e4a-49ee-bdd0-a19437f9d17d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:14.206487 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1edf1bce-3e4a-49ee-bdd0-a19437f9d17d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.204735 Aug 02 09:07:14.207072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 85/167] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:14 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:14.469465 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2aae5331-bbb4-4354-8d71-b5a12392262f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:14.470446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2aae5331-bbb4-4354-8d71-b5a12392262f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:14.479551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2aae5331-bbb4-4354-8d71-b5a12392262f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.480105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2aae5331-bbb4-4354-8d71-b5a12392262f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.481163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2aae5331-bbb4-4354-8d71-b5a12392262f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.481666 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2aae5331-bbb4-4354-8d71-b5a12392262f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.639292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2aae5331-bbb4-4354-8d71-b5a12392262f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:14.647053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2aae5331-bbb4-4354-8d71-b5a12392262f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.184294 Aug 02 09:07:14.647625 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 83/168] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:14 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:14.879574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e0e36213-5cd9-4879-823f-b5044e157ce5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:14.881087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e0e36213-5cd9-4879-823f-b5044e157ce5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:14.888415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e0e36213-5cd9-4879-823f-b5044e157ce5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.892123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e0e36213-5cd9-4879-823f-b5044e157ce5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:14.892123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e0e36213-5cd9-4879-823f-b5044e157ce5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:14.892123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e0e36213-5cd9-4879-823f-b5044e157ce5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.136259 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e0e36213-5cd9-4879-823f-b5044e157ce5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:15.154179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e0e36213-5cd9-4879-823f-b5044e157ce5 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.276024 Aug 02 09:07:15.156066 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 86/169] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:14 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:15.187189 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:15.187855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:15.194163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:15.194617 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.195382 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:15.195872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.231060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-633c2e3a-8b5c-4996-9234-1d5ab489a595 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:15.232097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-633c2e3a-8b5c-4996-9234-1d5ab489a595 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:15.240158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-633c2e3a-8b5c-4996-9234-1d5ab489a595 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:15.240833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-633c2e3a-8b5c-4996-9234-1d5ab489a595 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.241968 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-633c2e3a-8b5c-4996-9234-1d5ab489a595 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:15.242620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-633c2e3a-8b5c-4996-9234-1d5ab489a595 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.412541 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:15.422806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:15.428379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:15.429798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f9c1eaa1-615c-47b9-bd16-482c95cc8a85 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.248683 Aug 02 09:07:15.430853 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 84/170] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:15 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:15.458612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-633c2e3a-8b5c-4996-9234-1d5ab489a595 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:15.467267 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-633c2e3a-8b5c-4996-9234-1d5ab489a595 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.242026 Aug 02 09:07:15.467860 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 87/171] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:15 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:15.668675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6c57c8a1-6c3e-4885-8eae-e604ac2ddc39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:15.669289 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6c57c8a1-6c3e-4885-8eae-e604ac2ddc39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:15.676008 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c57c8a1-6c3e-4885-8eae-e604ac2ddc39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:15.676492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c57c8a1-6c3e-4885-8eae-e604ac2ddc39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.678227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c57c8a1-6c3e-4885-8eae-e604ac2ddc39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:15.679059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c57c8a1-6c3e-4885-8eae-e604ac2ddc39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:15.839329 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6c57c8a1-6c3e-4885-8eae-e604ac2ddc39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:15.847381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6c57c8a1-6c3e-4885-8eae-e604ac2ddc39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.183271 Aug 02 09:07:15.857509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 85/172] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:15 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:16.179542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7d951aeb-4841-40d4-9648-7cf84632b65d tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:16.180609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7d951aeb-4841-40d4-9648-7cf84632b65d tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:16.188682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7d951aeb-4841-40d4-9648-7cf84632b65d tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.189281 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7d951aeb-4841-40d4-9648-7cf84632b65d tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.190457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7d951aeb-4841-40d4-9648-7cf84632b65d tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.191286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7d951aeb-4841-40d4-9648-7cf84632b65d tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.364757 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7d951aeb-4841-40d4-9648-7cf84632b65d tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:16.374083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7d951aeb-4841-40d4-9648-7cf84632b65d tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.200088 Aug 02 09:07:16.392497 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 88/173] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:16 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:16.460324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:16.461096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:16.469576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.471457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.471457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.471873 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.489266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fa083827-ee83-4c99-b635-eb8d83d999b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:16.489919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fa083827-ee83-4c99-b635-eb8d83d999b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:16.496837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:16.501803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fa083827-ee83-4c99-b635-eb8d83d999b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.502367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fa083827-ee83-4c99-b635-eb8d83d999b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.506331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fa083827-ee83-4c99-b635-eb8d83d999b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.506331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fa083827-ee83-4c99-b635-eb8d83d999b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.646706 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:16.655327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:16.656822 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:16.658097 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b1739228-c1b6-435a-9560-b591b2db8791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.202108 Aug 02 09:07:16.675147 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 86/174] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:16 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:16.703062 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fa083827-ee83-4c99-b635-eb8d83d999b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:16.711087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fa083827-ee83-4c99-b635-eb8d83d999b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.226613 Aug 02 09:07:16.711655 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 89/175] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:16 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:16.880064 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-39d9b597-fcf7-4632-bf51-28b404ffd690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:16.880064 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-39d9b597-fcf7-4632-bf51-28b404ffd690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:16.882738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-39d9b597-fcf7-4632-bf51-28b404ffd690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.883276 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-39d9b597-fcf7-4632-bf51-28b404ffd690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:16.884159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-39d9b597-fcf7-4632-bf51-28b404ffd690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:16.884987 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-39d9b597-fcf7-4632-bf51-28b404ffd690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.039622 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-39d9b597-fcf7-4632-bf51-28b404ffd690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:17.048051 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-39d9b597-fcf7-4632-bf51-28b404ffd690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.178234 Aug 02 09:07:17.048605 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 87/176] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:16 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:17.399128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-eeac60e5-153b-4b54-afe9-a7e5b4872477 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:17.400939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-eeac60e5-153b-4b54-afe9-a7e5b4872477 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:17.408433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eeac60e5-153b-4b54-afe9-a7e5b4872477 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:17.408891 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eeac60e5-153b-4b54-afe9-a7e5b4872477 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.409657 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eeac60e5-153b-4b54-afe9-a7e5b4872477 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:17.410109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eeac60e5-153b-4b54-afe9-a7e5b4872477 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.596323 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-eeac60e5-153b-4b54-afe9-a7e5b4872477 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:17.606334 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-eeac60e5-153b-4b54-afe9-a7e5b4872477 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.212321 Aug 02 09:07:17.607271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 90/177] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:17 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:17.691533 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:17.692601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:17.699190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:17.711135 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:17.711395 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.713447 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:17.714454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.740520 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-90998a3b-1728-4cc1-8ea6-762f8582616f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:17.741367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-90998a3b-1728-4cc1-8ea6-762f8582616f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:17.749706 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-90998a3b-1728-4cc1-8ea6-762f8582616f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:17.750178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-90998a3b-1728-4cc1-8ea6-762f8582616f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.751077 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-90998a3b-1728-4cc1-8ea6-762f8582616f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:17.751509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-90998a3b-1728-4cc1-8ea6-762f8582616f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:17.880812 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:17.885357 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:17.894206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:17.894206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:17.894206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-99a413ee-60be-4f9d-80c4-2bbc8820e479 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.209253 Aug 02 09:07:17.900848 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 88/178] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:17 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:07:17.981135 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-90998a3b-1728-4cc1-8ea6-762f8582616f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:17.991354 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-90998a3b-1728-4cc1-8ea6-762f8582616f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.254983 Aug 02 09:07:17.992008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 91/179] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:17 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:18.068843 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-80d16cc2-68a8-4039-b57f-c3e30e6af976 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:18.069470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-80d16cc2-68a8-4039-b57f-c3e30e6af976 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:18.076523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-80d16cc2-68a8-4039-b57f-c3e30e6af976 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:18.076989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-80d16cc2-68a8-4039-b57f-c3e30e6af976 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:18.077753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-80d16cc2-68a8-4039-b57f-c3e30e6af976 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:18.078206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-80d16cc2-68a8-4039-b57f-c3e30e6af976 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:18.249023 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-80d16cc2-68a8-4039-b57f-c3e30e6af976 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:18.256861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-80d16cc2-68a8-4039-b57f-c3e30e6af976 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.191509 Aug 02 09:07:18.257420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 89/180] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:18 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:18.644126 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-88499893-797f-4823-b0da-e9e8bc1e9556 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:18.646135 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-88499893-797f-4823-b0da-e9e8bc1e9556 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:18.664724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88499893-797f-4823-b0da-e9e8bc1e9556 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:18.665457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88499893-797f-4823-b0da-e9e8bc1e9556 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:18.667169 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88499893-797f-4823-b0da-e9e8bc1e9556 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:18.667902 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88499893-797f-4823-b0da-e9e8bc1e9556 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:18.834564 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-88499893-797f-4823-b0da-e9e8bc1e9556 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:18.851319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-88499893-797f-4823-b0da-e9e8bc1e9556 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.215131 Aug 02 09:07:18.866521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 92/181] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:18 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:18.924468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:18.925230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:18.944873 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:18.945380 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:18.949749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:18.949749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:19.012687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-aee588e1-389c-45ff-a6ac-b5ae43d3a1c1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:19.013182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-aee588e1-389c-45ff-a6ac-b5ae43d3a1c1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:19.024058 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aee588e1-389c-45ff-a6ac-b5ae43d3a1c1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:19.025603 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aee588e1-389c-45ff-a6ac-b5ae43d3a1c1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:19.027207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aee588e1-389c-45ff-a6ac-b5ae43d3a1c1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:19.027817 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aee588e1-389c-45ff-a6ac-b5ae43d3a1c1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:19.216644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-aee588e1-389c-45ff-a6ac-b5ae43d3a1c1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:19.226441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-aee588e1-389c-45ff-a6ac-b5ae43d3a1c1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.217420 Aug 02 09:07:19.227529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 93/182] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:19 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:19.271976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:19.284161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:19.286621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:19.287175 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-891bfebe-d895-4f9c-b1a1-78c9d883881a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:19.287623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0020374c-b937-40fd-9fb5-628abafb09fe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.369292 Aug 02 09:07:19.288658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-891bfebe-d895-4f9c-b1a1-78c9d883881a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:19.289434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 90/183] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:18 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:19.306488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-891bfebe-d895-4f9c-b1a1-78c9d883881a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:19.307063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-891bfebe-d895-4f9c-b1a1-78c9d883881a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:19.308042 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-891bfebe-d895-4f9c-b1a1-78c9d883881a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:19.309010 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-891bfebe-d895-4f9c-b1a1-78c9d883881a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:19.497233 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-891bfebe-d895-4f9c-b1a1-78c9d883881a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:19.505843 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-891bfebe-d895-4f9c-b1a1-78c9d883881a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.229751 Aug 02 09:07:19.506552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 94/184] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:19 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:19.874579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-78863566-435c-4110-a9ba-48cc6c09a50b tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:19.875180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-78863566-435c-4110-a9ba-48cc6c09a50b tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:19.885362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-78863566-435c-4110-a9ba-48cc6c09a50b tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:19.886114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-78863566-435c-4110-a9ba-48cc6c09a50b tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:19.887070 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-78863566-435c-4110-a9ba-48cc6c09a50b tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:19.887521 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-78863566-435c-4110-a9ba-48cc6c09a50b tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.223493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-78863566-435c-4110-a9ba-48cc6c09a50b tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:20.233820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-78863566-435c-4110-a9ba-48cc6c09a50b tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.361817 Aug 02 09:07:20.233820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 91/185] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:19 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:20.262453 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-837fe08a-897e-4d9c-a4e3-770d7ce5a027 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:20.262453 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-837fe08a-897e-4d9c-a4e3-770d7ce5a027 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:20.268682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-837fe08a-897e-4d9c-a4e3-770d7ce5a027 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.269134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-837fe08a-897e-4d9c-a4e3-770d7ce5a027 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.270025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-837fe08a-897e-4d9c-a4e3-770d7ce5a027 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.270454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-837fe08a-897e-4d9c-a4e3-770d7ce5a027 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.320899 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:20.322768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:20.332974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.335121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.336275 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.336939 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.678403 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:20.688082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:20.690270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:20.692231 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-61c384e5-4c7d-4c40-8328-941cc5373042 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.378159 Aug 02 09:07:20.693076 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 92/186] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:20 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:07:20.699570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-71fe6cde-7854-4669-9fa1-58783159da2c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:20.700190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-71fe6cde-7854-4669-9fa1-58783159da2c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:20.707069 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-71fe6cde-7854-4669-9fa1-58783159da2c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.707509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-71fe6cde-7854-4669-9fa1-58783159da2c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.708276 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-71fe6cde-7854-4669-9fa1-58783159da2c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:20.708695 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-71fe6cde-7854-4669-9fa1-58783159da2c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:20.800560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-837fe08a-897e-4d9c-a4e3-770d7ce5a027 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:20.809832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-837fe08a-897e-4d9c-a4e3-770d7ce5a027 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.555830 Aug 02 09:07:20.823841 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 95/187] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:20 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:21.168934 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-71fe6cde-7854-4669-9fa1-58783159da2c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:21.177856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-71fe6cde-7854-4669-9fa1-58783159da2c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.483345 Aug 02 09:07:21.178809 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 93/188] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:20 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:21.267303 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cf7f1d63-bd9b-4c79-9109-50178be39b7e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:21.269657 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cf7f1d63-bd9b-4c79-9109-50178be39b7e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:21.283893 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cf7f1d63-bd9b-4c79-9109-50178be39b7e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:21.284982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cf7f1d63-bd9b-4c79-9109-50178be39b7e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:21.286795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cf7f1d63-bd9b-4c79-9109-50178be39b7e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:21.288134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cf7f1d63-bd9b-4c79-9109-50178be39b7e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:21.346628 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:21.633318 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cf7f1d63-bd9b-4c79-9109-50178be39b7e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:21.642153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cf7f1d63-bd9b-4c79-9109-50178be39b7e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.390196 Aug 02 09:07:21.643364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 96/189] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:21 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:21.727195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:21.732389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:21.748866 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:21.749449 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:21.750125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:21.750561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:21.834916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1d12c471-7488-4c02-a484-517f3d9929f0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:21.835573 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1d12c471-7488-4c02-a484-517f3d9929f0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:21.844385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1d12c471-7488-4c02-a484-517f3d9929f0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:21.845115 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1d12c471-7488-4c02-a484-517f3d9929f0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:21.846097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1d12c471-7488-4c02-a484-517f3d9929f0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:21.846583 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1d12c471-7488-4c02-a484-517f3d9929f0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:21.993324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:22.002493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:22.004002 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:22.005318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b17f3428-64a4-473e-a7bd-8d90d5ba65c6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1406 microversion: 2.20 time: 0.290584 Aug 02 09:07:22.005850 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 94/190] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:21 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:22.147449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1d12c471-7488-4c02-a484-517f3d9929f0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:22.166830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1d12c471-7488-4c02-a484-517f3d9929f0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.338158 Aug 02 09:07:22.180285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 97/191] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:21 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:22.216459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d5a928de-9e7e-492d-96bb-cbc93bd69eaf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:22.217312 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d5a928de-9e7e-492d-96bb-cbc93bd69eaf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:22.230267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5a928de-9e7e-492d-96bb-cbc93bd69eaf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:22.233734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5a928de-9e7e-492d-96bb-cbc93bd69eaf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:22.239954 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5a928de-9e7e-492d-96bb-cbc93bd69eaf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:22.239954 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5a928de-9e7e-492d-96bb-cbc93bd69eaf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:22.672716 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-82b22de6-bc42-4df1-b368-c38df2bb348e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:22.674878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-82b22de6-bc42-4df1-b368-c38df2bb348e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:22.700774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d5a928de-9e7e-492d-96bb-cbc93bd69eaf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:22.725560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-82b22de6-bc42-4df1-b368-c38df2bb348e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:22.728620 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d5a928de-9e7e-492d-96bb-cbc93bd69eaf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.516975 Aug 02 09:07:22.734321 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 95/192] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:22 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:22.734704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-82b22de6-bc42-4df1-b368-c38df2bb348e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:22.735862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-82b22de6-bc42-4df1-b368-c38df2bb348e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:22.736463 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-82b22de6-bc42-4df1-b368-c38df2bb348e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:22.833275 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-3d2941ba-9fdf-4a3a-8886-6b479219a956 req-e098b56d-ed9e-4c58-86aa-a30db907d0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b281103-e2e9-4a29-93a6-80ef8943841a", "name": "network-vif-plugged", "status": "completed", "tag": "9239d9b4-016e-4388-8e77-96d7b816177a"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:22.891001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-3d2941ba-9fdf-4a3a-8886-6b479219a956 req-e098b56d-ed9e-4c58-86aa-a30db907d0dc service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:22.892036 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-3d2941ba-9fdf-4a3a-8886-6b479219a956 req-e098b56d-ed9e-4c58-86aa-a30db907d0dc service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.033430 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-3d2941ba-9fdf-4a3a-8886-6b479219a956 req-e098b56d-ed9e-4c58-86aa-a30db907d0dc service nova] Creating event network-vif-plugged:9239d9b4-016e-4388-8e77-96d7b816177a for instance 6b281103-e2e9-4a29-93a6-80ef8943841a on hv-cinder-84713 Aug 02 09:07:23.034303 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-3d2941ba-9fdf-4a3a-8886-6b479219a956 req-e098b56d-ed9e-4c58-86aa-a30db907d0dc service nova] Acquired lock "compute-rpcapi-router" {{(pid=118366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 09:07:23.036700 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35405fcc-0347-4120-a5b6-fb173f5bb477 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.037357 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35405fcc-0347-4120-a5b6-fb173f5bb477 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.039346 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35405fcc-0347-4120-a5b6-fb173f5bb477 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.053370 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35405fcc-0347-4120-a5b6-fb173f5bb477 None None] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.091988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.compute.rpcapi [None req-35405fcc-0347-4120-a5b6-fb173f5bb477 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 09:07:23.106207 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35405fcc-0347-4120-a5b6-fb173f5bb477 None None] Releasing lock "compute-rpcapi-router" {{(pid=118366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 09:07:23.173454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-35405fcc-0347-4120-a5b6-fb173f5bb477 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345307 Aug 02 09:07:23.174496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 96/193] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:23.188324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:23.189277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:23.209311 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.210103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.211400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.212141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.395919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-82b22de6-bc42-4df1-b368-c38df2bb348e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:23.418505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-82b22de6-bc42-4df1-b368-c38df2bb348e tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.758612 Aug 02 09:07:23.432193 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 98/194] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:22 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:23.447576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-88457f87-e507-4e18-b87a-63ceebe0af0c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:23.448962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-88457f87-e507-4e18-b87a-63ceebe0af0c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:23.475532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88457f87-e507-4e18-b87a-63ceebe0af0c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.479558 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88457f87-e507-4e18-b87a-63ceebe0af0c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.481062 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88457f87-e507-4e18-b87a-63ceebe0af0c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.481867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88457f87-e507-4e18-b87a-63ceebe0af0c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.739779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:23.753094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:23.755946 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:23.758123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-45b78630-2dec-4645-bb81-9f03aaff0cf3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1596 microversion: 2.20 time: 0.581644 Aug 02 09:07:23.780686 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 97/195] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:07:23 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1596 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:07:23.788222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e07435ea-9cad-4b56-987a-fe4c2e5e9e2a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:23.789205 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e07435ea-9cad-4b56-987a-fe4c2e5e9e2a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:23.805347 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e07435ea-9cad-4b56-987a-fe4c2e5e9e2a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.805991 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e07435ea-9cad-4b56-987a-fe4c2e5e9e2a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.811191 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e07435ea-9cad-4b56-987a-fe4c2e5e9e2a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:23.812524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e07435ea-9cad-4b56-987a-fe4c2e5e9e2a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:23.972247 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-88457f87-e507-4e18-b87a-63ceebe0af0c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:23.990882 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-88457f87-e507-4e18-b87a-63ceebe0af0c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.556735 Aug 02 09:07:23.992867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 99/196] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:23 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:24.003362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e72c329a-10d2-4d76-aba5-685a68de3ac6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:24.004306 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e72c329a-10d2-4d76-aba5-685a68de3ac6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:24.015662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e72c329a-10d2-4d76-aba5-685a68de3ac6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.016726 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e72c329a-10d2-4d76-aba5-685a68de3ac6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.018225 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e72c329a-10d2-4d76-aba5-685a68de3ac6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.020669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e72c329a-10d2-4d76-aba5-685a68de3ac6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.097612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e07435ea-9cad-4b56-987a-fe4c2e5e9e2a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:24.118070 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e07435ea-9cad-4b56-987a-fe4c2e5e9e2a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.333759 Aug 02 09:07:24.119768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 98/197] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:23 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:24.280962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e72c329a-10d2-4d76-aba5-685a68de3ac6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.285852 Aug 02 09:07:24.282558 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 100/198] 10.222.0.46 () {60 vars in 1316 bytes} [Tue Aug 2 09:07:23 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:07:24.458686 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c0db1290-459e-4411-9857-d9b720b336c3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:24.459081 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c0db1290-459e-4411-9857-d9b720b336c3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:24.479997 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c0db1290-459e-4411-9857-d9b720b336c3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.480789 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c0db1290-459e-4411-9857-d9b720b336c3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.481963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c0db1290-459e-4411-9857-d9b720b336c3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:24.482561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c0db1290-459e-4411-9857-d9b720b336c3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:24.806065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c0db1290-459e-4411-9857-d9b720b336c3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:24.816503 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c0db1290-459e-4411-9857-d9b720b336c3 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1314 microversion: 2.1 time: 0.362830 Aug 02 09:07:24.818009 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 99/199] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:24 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:25.021508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0cce680c-1499-4591-8a96-7ccc769ed6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:25.022450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0cce680c-1499-4591-8a96-7ccc769ed6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:25.049432 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0cce680c-1499-4591-8a96-7ccc769ed6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.051155 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0cce680c-1499-4591-8a96-7ccc769ed6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.052796 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0cce680c-1499-4591-8a96-7ccc769ed6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.058246 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0cce680c-1499-4591-8a96-7ccc769ed6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.144398 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8e116006-2aea-4b90-a780-23fca326e4d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:25.145055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8e116006-2aea-4b90-a780-23fca326e4d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:25.152523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8e116006-2aea-4b90-a780-23fca326e4d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.153178 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8e116006-2aea-4b90-a780-23fca326e4d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.154163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8e116006-2aea-4b90-a780-23fca326e4d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.154741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8e116006-2aea-4b90-a780-23fca326e4d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.447831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8e116006-2aea-4b90-a780-23fca326e4d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:25.475570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8e116006-2aea-4b90-a780-23fca326e4d0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.336300 Aug 02 09:07:25.476179 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 100/200] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:25 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:25.484103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-0ed79671-3df8-43aa-b49e-234ab9028175 req-c66a3486-2b8a-4d33-84c0-0cee263a4254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc22a12f-291a-4c23-add9-09a32ae7202e", "name": "network-vif-plugged", "status": "completed", "tag": "9c3cf01f-81d0-4a72-b4fb-cf0e71bc6406"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:25.500859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-0ed79671-3df8-43aa-b49e-234ab9028175 req-c66a3486-2b8a-4d33-84c0-0cee263a4254 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.501676 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-0ed79671-3df8-43aa-b49e-234ab9028175 req-c66a3486-2b8a-4d33-84c0-0cee263a4254 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.527293 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-0ed79671-3df8-43aa-b49e-234ab9028175 req-c66a3486-2b8a-4d33-84c0-0cee263a4254 service nova] Creating event network-vif-plugged:9c3cf01f-81d0-4a72-b4fb-cf0e71bc6406 for instance dc22a12f-291a-4c23-add9-09a32ae7202e on hv-cinder-84713 Aug 02 09:07:25.543371 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-0ed79671-3df8-43aa-b49e-234ab9028175 req-c66a3486-2b8a-4d33-84c0-0cee263a4254 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063985 Aug 02 09:07:25.545143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 101/201] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:25.854586 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-44f79a9c-f09a-4edc-b98e-9e84880d3fcc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:25.855922 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-44f79a9c-f09a-4edc-b98e-9e84880d3fcc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:25.878012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44f79a9c-f09a-4edc-b98e-9e84880d3fcc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.879053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44f79a9c-f09a-4edc-b98e-9e84880d3fcc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.880727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44f79a9c-f09a-4edc-b98e-9e84880d3fcc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:25.882102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44f79a9c-f09a-4edc-b98e-9e84880d3fcc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:25.975727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0cce680c-1499-4591-8a96-7ccc769ed6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:25.988593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0cce680c-1499-4591-8a96-7ccc769ed6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.973668 Aug 02 09:07:25.989194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 101/202] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:25 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:26.511641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9c1f600b-a5f2-4425-8d9b-344c3241e53e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:26.512454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9c1f600b-a5f2-4425-8d9b-344c3241e53e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:26.521133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9c1f600b-a5f2-4425-8d9b-344c3241e53e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:26.521594 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9c1f600b-a5f2-4425-8d9b-344c3241e53e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:26.522548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9c1f600b-a5f2-4425-8d9b-344c3241e53e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:26.523125 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9c1f600b-a5f2-4425-8d9b-344c3241e53e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:26.800948 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-44f79a9c-f09a-4edc-b98e-9e84880d3fcc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:26.813375 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-44f79a9c-f09a-4edc-b98e-9e84880d3fcc tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1500 microversion: 2.1 time: 0.965837 Aug 02 09:07:26.815403 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 102/203] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:25 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1500 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:27.011663 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9c1f600b-a5f2-4425-8d9b-344c3241e53e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:27.019220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-53f03a74-d5fd-4da2-8288-5f8aa7647b3c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:27.019965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-53f03a74-d5fd-4da2-8288-5f8aa7647b3c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:27.027767 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9c1f600b-a5f2-4425-8d9b-344c3241e53e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.523573 Aug 02 09:07:27.031330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 102/204] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:26 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:27.031886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-53f03a74-d5fd-4da2-8288-5f8aa7647b3c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:27.039708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-53f03a74-d5fd-4da2-8288-5f8aa7647b3c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:27.042512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-53f03a74-d5fd-4da2-8288-5f8aa7647b3c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:27.043148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-53f03a74-d5fd-4da2-8288-5f8aa7647b3c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:27.432690 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-53f03a74-d5fd-4da2-8288-5f8aa7647b3c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:27.452396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-53f03a74-d5fd-4da2-8288-5f8aa7647b3c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.437055 Aug 02 09:07:27.453619 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 103/205] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:27 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:27.830144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-964dca05-df4a-4408-8b13-871779da4cf1 req-e5b01f4e-ea48-4289-8f6e-f2809ad1c199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c248147-71ed-4f5f-89cc-8ca12974efb4", "tag": "27491509-00ef-451e-b2ac-f08e653e8310"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:27.841870 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-964dca05-df4a-4408-8b13-871779da4cf1 req-e5b01f4e-ea48-4289-8f6e-f2809ad1c199 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:27.854223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-964dca05-df4a-4408-8b13-871779da4cf1 req-e5b01f4e-ea48-4289-8f6e-f2809ad1c199 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:27.880051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-964dca05-df4a-4408-8b13-871779da4cf1 req-e5b01f4e-ea48-4289-8f6e-f2809ad1c199 service nova] Creating event network-changed:27491509-00ef-451e-b2ac-f08e653e8310 for instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 on hv-cinder-84713 Aug 02 09:07:27.889841 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-964dca05-df4a-4408-8b13-871779da4cf1 req-e5b01f4e-ea48-4289-8f6e-f2809ad1c199 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061353 Aug 02 09:07:27.890722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 103/206] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:28.059695 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-40d977f9-d632-4ddc-8443-dbbf00abd641 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:28.062968 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-40d977f9-d632-4ddc-8443-dbbf00abd641 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:28.126671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-40d977f9-d632-4ddc-8443-dbbf00abd641 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:28.129533 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-40d977f9-d632-4ddc-8443-dbbf00abd641 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:28.131418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-40d977f9-d632-4ddc-8443-dbbf00abd641 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:28.135487 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-40d977f9-d632-4ddc-8443-dbbf00abd641 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:28.477369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-96de2986-9294-4297-9740-2caa40627a15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:28.478554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-96de2986-9294-4297-9740-2caa40627a15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:28.488862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96de2986-9294-4297-9740-2caa40627a15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:28.489314 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96de2986-9294-4297-9740-2caa40627a15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:28.490254 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-40d977f9-d632-4ddc-8443-dbbf00abd641 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:28.492064 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96de2986-9294-4297-9740-2caa40627a15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:28.494906 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96de2986-9294-4297-9740-2caa40627a15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:28.504349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-40d977f9-d632-4ddc-8443-dbbf00abd641 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1322 microversion: 2.1 time: 0.452754 Aug 02 09:07:28.508846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 104/207] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:28 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:28.726797 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-96de2986-9294-4297-9740-2caa40627a15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:28.737615 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-96de2986-9294-4297-9740-2caa40627a15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1366 microversion: 2.1 time: 0.265430 Aug 02 09:07:28.739198 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 104/208] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:28 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:29.535979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-82c2ede3-9a92-4341-a05d-67294edaa0ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:29.538585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-82c2ede3-9a92-4341-a05d-67294edaa0ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:29.555488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-82c2ede3-9a92-4341-a05d-67294edaa0ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:29.558060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-82c2ede3-9a92-4341-a05d-67294edaa0ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:29.560163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-82c2ede3-9a92-4341-a05d-67294edaa0ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:29.562654 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-82c2ede3-9a92-4341-a05d-67294edaa0ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:29.763510 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a79d5660-a900-48d2-a4c6-c1049682f2ae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:29.764364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a79d5660-a900-48d2-a4c6-c1049682f2ae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:29.775797 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a79d5660-a900-48d2-a4c6-c1049682f2ae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:29.777060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a79d5660-a900-48d2-a4c6-c1049682f2ae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:29.781622 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a79d5660-a900-48d2-a4c6-c1049682f2ae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:29.784341 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a79d5660-a900-48d2-a4c6-c1049682f2ae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:29.844056 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-82c2ede3-9a92-4341-a05d-67294edaa0ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:29.870326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-82c2ede3-9a92-4341-a05d-67294edaa0ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1516 microversion: 2.1 time: 0.342995 Aug 02 09:07:29.875111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 105/209] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:29 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1516 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:29.899594 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-db7acd04-25dc-45bd-a9b9-da5dde6f12a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:29.902929 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-db7acd04-25dc-45bd-a9b9-da5dde6f12a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:29.913270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-db7acd04-25dc-45bd-a9b9-da5dde6f12a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:29.914577 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-db7acd04-25dc-45bd-a9b9-da5dde6f12a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:29.941036 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-db7acd04-25dc-45bd-a9b9-da5dde6f12a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:29.942031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-db7acd04-25dc-45bd-a9b9-da5dde6f12a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:30.056667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:30.081431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-db7acd04-25dc-45bd-a9b9-da5dde6f12a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lazy-loading 'flavor' on Instance uuid 6b281103-e2e9-4a29-93a6-80ef8943841a {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:07:30.208140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a79d5660-a900-48d2-a4c6-c1049682f2ae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:30.219514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a79d5660-a900-48d2-a4c6-c1049682f2ae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1554 microversion: 2.1 time: 0.462506 Aug 02 09:07:30.223367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 105/210] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:29 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1554 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:30.246766 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2496095b-e588-4724-8581-d24518dc05fa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:30.247469 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2496095b-e588-4724-8581-d24518dc05fa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:30.257405 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2496095b-e588-4724-8581-d24518dc05fa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:30.264218 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2496095b-e588-4724-8581-d24518dc05fa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:30.265067 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2496095b-e588-4724-8581-d24518dc05fa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:30.265563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2496095b-e588-4724-8581-d24518dc05fa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:30.597994 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2496095b-e588-4724-8581-d24518dc05fa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.355999 Aug 02 09:07:30.598572 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 106/211] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 2 09:07:30 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-interface => generated 284 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:30.604124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-69dc08e4-589b-4240-9dbc-3d6b3d223a8a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60cd9723-9f99-473f-82cf-473a30f9862d"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:30.608303 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-69dc08e4-589b-4240-9dbc-3d6b3d223a8a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:30.615662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-69dc08e4-589b-4240-9dbc-3d6b3d223a8a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:30.615940 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-69dc08e4-589b-4240-9dbc-3d6b3d223a8a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:30.627691 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-69dc08e4-589b-4240-9dbc-3d6b3d223a8a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:30.627691 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-69dc08e4-589b-4240-9dbc-3d6b3d223a8a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:30.719205 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-db7acd04-25dc-45bd-a9b9-da5dde6f12a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a/action" status: 200 len: 32 microversion: 2.1 time: 0.824336 Aug 02 09:07:30.719975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 106/212] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:07:29 2022] POST /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a/action => generated 32 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:07:30.755797 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8a1fd2e4-3613-4a8b-8c35-55306e0ac40b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:30.761112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8a1fd2e4-3613-4a8b-8c35-55306e0ac40b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:30.790673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a1fd2e4-3613-4a8b-8c35-55306e0ac40b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:30.798359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a1fd2e4-3613-4a8b-8c35-55306e0ac40b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:30.801424 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a1fd2e4-3613-4a8b-8c35-55306e0ac40b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:30.803243 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a1fd2e4-3613-4a8b-8c35-55306e0ac40b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:31.513935 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8a1fd2e4-3613-4a8b-8c35-55306e0ac40b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:31.544587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8a1fd2e4-3613-4a8b-8c35-55306e0ac40b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.812712 Aug 02 09:07:31.548105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 107/213] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:30 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:32.047480 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-69dc08e4-589b-4240-9dbc-3d6b3d223a8a tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "POST /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.447170 Aug 02 09:07:32.048752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 107/214] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:07:30 2022] POST /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748/os-volume_attachments => generated 194 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:32.574494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a3686bbd-0e2a-49dc-96a0-3ed9b92a2e85 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:32.575162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a3686bbd-0e2a-49dc-96a0-3ed9b92a2e85 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:32.585194 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3686bbd-0e2a-49dc-96a0-3ed9b92a2e85 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:32.591195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3686bbd-0e2a-49dc-96a0-3ed9b92a2e85 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:32.591195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3686bbd-0e2a-49dc-96a0-3ed9b92a2e85 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:32.591195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3686bbd-0e2a-49dc-96a0-3ed9b92a2e85 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:32.862816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a3686bbd-0e2a-49dc-96a0-3ed9b92a2e85 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:32.871006 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a3686bbd-0e2a-49dc-96a0-3ed9b92a2e85 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.300957 Aug 02 09:07:32.871865 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 108/215] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:32 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:33.869635 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-ab9e93c8-3191-4a45-b63d-4571a71fdfca req-db2a2bf7-cb7f-47aa-b629-935df1c849e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc22a12f-291a-4c23-add9-09a32ae7202e", "tag": "9c3cf01f-81d0-4a72-b4fb-cf0e71bc6406"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:33.895598 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-bb41d9cd-c7ac-40ae-9491-33b2fc9dd662 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:33.896617 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-bb41d9cd-c7ac-40ae-9491-33b2fc9dd662 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:33.904182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-ab9e93c8-3191-4a45-b63d-4571a71fdfca req-db2a2bf7-cb7f-47aa-b629-935df1c849e9 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:33.913471 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-ab9e93c8-3191-4a45-b63d-4571a71fdfca req-db2a2bf7-cb7f-47aa-b629-935df1c849e9 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:33.913627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:33.916411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bb41d9cd-c7ac-40ae-9491-33b2fc9dd662 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:33.917162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bb41d9cd-c7ac-40ae-9491-33b2fc9dd662 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:33.918508 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bb41d9cd-c7ac-40ae-9491-33b2fc9dd662 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:33.919233 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bb41d9cd-c7ac-40ae-9491-33b2fc9dd662 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:33.920459 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-ab9e93c8-3191-4a45-b63d-4571a71fdfca req-db2a2bf7-cb7f-47aa-b629-935df1c849e9 service nova] Creating event network-changed:9c3cf01f-81d0-4a72-b4fb-cf0e71bc6406 for instance dc22a12f-291a-4c23-add9-09a32ae7202e on hv-cinder-84713 Aug 02 09:07:33.941237 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-ab9e93c8-3191-4a45-b63d-4571a71fdfca req-db2a2bf7-cb7f-47aa-b629-935df1c849e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070166 Aug 02 09:07:33.944313 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 108/216] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:34.178209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bb41d9cd-c7ac-40ae-9491-33b2fc9dd662 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:34.189115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-bb41d9cd-c7ac-40ae-9491-33b2fc9dd662 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.300009 Aug 02 09:07:34.190078 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 109/217] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:33 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:35.217070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ba08ab4a-62ff-48e1-a0fe-21ed5b02f293 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:35.217767 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ba08ab4a-62ff-48e1-a0fe-21ed5b02f293 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:35.240285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ba08ab4a-62ff-48e1-a0fe-21ed5b02f293 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:35.242600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ba08ab4a-62ff-48e1-a0fe-21ed5b02f293 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:35.246585 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ba08ab4a-62ff-48e1-a0fe-21ed5b02f293 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:35.247036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ba08ab4a-62ff-48e1-a0fe-21ed5b02f293 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:35.422269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ba08ab4a-62ff-48e1-a0fe-21ed5b02f293 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:35.431481 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ba08ab4a-62ff-48e1-a0fe-21ed5b02f293 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.222454 Aug 02 09:07:35.445118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 109/218] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:35 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:36.453285 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9a1701d4-ffe8-469b-8fa1-1bb53defd23b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:36.455652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9a1701d4-ffe8-469b-8fa1-1bb53defd23b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:36.464457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a1701d4-ffe8-469b-8fa1-1bb53defd23b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:36.466462 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a1701d4-ffe8-469b-8fa1-1bb53defd23b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:36.467808 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a1701d4-ffe8-469b-8fa1-1bb53defd23b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:36.468467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a1701d4-ffe8-469b-8fa1-1bb53defd23b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:36.720102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9a1701d4-ffe8-469b-8fa1-1bb53defd23b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:36.739176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9a1701d4-ffe8-469b-8fa1-1bb53defd23b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.290268 Aug 02 09:07:36.740332 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 110/219] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:36 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:37.762867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-29123c59-4508-4597-9b82-3271583a4ec4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:37.763477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-29123c59-4508-4597-9b82-3271583a4ec4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:37.776682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29123c59-4508-4597-9b82-3271583a4ec4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:37.778226 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29123c59-4508-4597-9b82-3271583a4ec4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:37.780139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29123c59-4508-4597-9b82-3271583a4ec4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:37.780960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29123c59-4508-4597-9b82-3271583a4ec4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:38.150885 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-29123c59-4508-4597-9b82-3271583a4ec4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:38.158896 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-29123c59-4508-4597-9b82-3271583a4ec4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.401351 Aug 02 09:07:38.189505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 110/220] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:37 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:39.187856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ccddbd0b-ae33-4705-a60c-14e839ee82f1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:39.188468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ccddbd0b-ae33-4705-a60c-14e839ee82f1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:39.197781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ccddbd0b-ae33-4705-a60c-14e839ee82f1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:39.198259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ccddbd0b-ae33-4705-a60c-14e839ee82f1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:39.199041 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ccddbd0b-ae33-4705-a60c-14e839ee82f1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:39.199661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ccddbd0b-ae33-4705-a60c-14e839ee82f1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:39.387092 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ccddbd0b-ae33-4705-a60c-14e839ee82f1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:39.407464 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ccddbd0b-ae33-4705-a60c-14e839ee82f1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.221003 Aug 02 09:07:39.410132 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 111/221] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:39 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:40.429193 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4c45d5fc-1004-414d-a356-6f768490e234 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:40.429797 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4c45d5fc-1004-414d-a356-6f768490e234 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:40.442117 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c45d5fc-1004-414d-a356-6f768490e234 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:40.444542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c45d5fc-1004-414d-a356-6f768490e234 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:40.445650 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c45d5fc-1004-414d-a356-6f768490e234 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:40.446111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c45d5fc-1004-414d-a356-6f768490e234 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:40.690408 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4c45d5fc-1004-414d-a356-6f768490e234 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:40.698786 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4c45d5fc-1004-414d-a356-6f768490e234 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.273334 Aug 02 09:07:40.700530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 111/222] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:40 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:41.726952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2e05f977-d4d7-4d3f-b2fe-276c7bf30d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:41.728344 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2e05f977-d4d7-4d3f-b2fe-276c7bf30d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:41.748116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2e05f977-d4d7-4d3f-b2fe-276c7bf30d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:41.752087 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2e05f977-d4d7-4d3f-b2fe-276c7bf30d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:41.754714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2e05f977-d4d7-4d3f-b2fe-276c7bf30d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:41.754714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2e05f977-d4d7-4d3f-b2fe-276c7bf30d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:41.984861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2e05f977-d4d7-4d3f-b2fe-276c7bf30d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:41.995490 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2e05f977-d4d7-4d3f-b2fe-276c7bf30d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.276291 Aug 02 09:07:42.014419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 112/223] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:41 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:43.023723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ca74ed1f-a0b9-493f-b023-23657f216356 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:43.025096 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ca74ed1f-a0b9-493f-b023-23657f216356 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:43.044497 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ca74ed1f-a0b9-493f-b023-23657f216356 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:43.046438 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ca74ed1f-a0b9-493f-b023-23657f216356 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:43.048001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ca74ed1f-a0b9-493f-b023-23657f216356 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:43.050420 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ca74ed1f-a0b9-493f-b023-23657f216356 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:43.353003 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ca74ed1f-a0b9-493f-b023-23657f216356 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:43.363199 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ca74ed1f-a0b9-493f-b023-23657f216356 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.342746 Aug 02 09:07:43.379452 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 112/224] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:43 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:44.390578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9a11a3d6-e7d5-48fb-87e1-341c3e7f7c32 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:44.391578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9a11a3d6-e7d5-48fb-87e1-341c3e7f7c32 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:44.398975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a11a3d6-e7d5-48fb-87e1-341c3e7f7c32 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:44.399413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a11a3d6-e7d5-48fb-87e1-341c3e7f7c32 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:44.401065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a11a3d6-e7d5-48fb-87e1-341c3e7f7c32 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:44.401658 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a11a3d6-e7d5-48fb-87e1-341c3e7f7c32 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:44.562021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9a11a3d6-e7d5-48fb-87e1-341c3e7f7c32 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:44.570938 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9a11a3d6-e7d5-48fb-87e1-341c3e7f7c32 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.187969 Aug 02 09:07:44.572196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 113/225] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:44 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:45.594622 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4c0a4b50-64f7-489d-b164-538d854ab0d8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:45.595239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4c0a4b50-64f7-489d-b164-538d854ab0d8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:45.620149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c0a4b50-64f7-489d-b164-538d854ab0d8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:45.623784 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c0a4b50-64f7-489d-b164-538d854ab0d8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:45.623784 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c0a4b50-64f7-489d-b164-538d854ab0d8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:45.625399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4c0a4b50-64f7-489d-b164-538d854ab0d8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:45.895327 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4c0a4b50-64f7-489d-b164-538d854ab0d8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:45.899401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:45.907654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4c0a4b50-64f7-489d-b164-538d854ab0d8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.318339 Aug 02 09:07:45.911183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 113/226] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:45 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:46.953565 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a16e2a25-bdcf-4dfc-ad29-910fc0a54e5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:46.955404 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a16e2a25-bdcf-4dfc-ad29-910fc0a54e5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:46.963618 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a16e2a25-bdcf-4dfc-ad29-910fc0a54e5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:46.967252 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a16e2a25-bdcf-4dfc-ad29-910fc0a54e5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:46.967252 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a16e2a25-bdcf-4dfc-ad29-910fc0a54e5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:46.967252 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a16e2a25-bdcf-4dfc-ad29-910fc0a54e5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:47.173844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a16e2a25-bdcf-4dfc-ad29-910fc0a54e5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:47.201529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a16e2a25-bdcf-4dfc-ad29-910fc0a54e5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.244076 Aug 02 09:07:47.201529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 114/227] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:46 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:48.214085 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-10950e53-8314-41ba-9eb5-77dec796182a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:48.214645 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6a4da76e-2de2-4f32-b845-86afe82e42a4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:48.214645 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6a4da76e-2de2-4f32-b845-86afe82e42a4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:48.216296 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-10950e53-8314-41ba-9eb5-77dec796182a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:48.224479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=49 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:48.226552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10950e53-8314-41ba-9eb5-77dec796182a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:48.228362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10950e53-8314-41ba-9eb5-77dec796182a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:48.229304 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=53 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:48.229806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10950e53-8314-41ba-9eb5-77dec796182a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:48.230473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10950e53-8314-41ba-9eb5-77dec796182a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:48.239411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6a4da76e-2de2-4f32-b845-86afe82e42a4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:48.239864 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6a4da76e-2de2-4f32-b845-86afe82e42a4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:48.241055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6a4da76e-2de2-4f32-b845-86afe82e42a4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:48.242526 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6a4da76e-2de2-4f32-b845-86afe82e42a4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:48.284669 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6a4da76e-2de2-4f32-b845-86afe82e42a4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:07:48.441149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-10950e53-8314-41ba-9eb5-77dec796182a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:48.452979 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-10950e53-8314-41ba-9eb5-77dec796182a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.246429 Aug 02 09:07:48.458080 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 114/228] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:48 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:49.069485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6a4da76e-2de2-4f32-b845-86afe82e42a4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 204 len: 0 microversion: 2.1 time: 0.859862 Aug 02 09:07:49.070212 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 115/229] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:07:48 2022] DELETE /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:07:49.079528 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bc3fd6ea-c15b-47a5-9938-1284f1860a00 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:49.080398 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bc3fd6ea-c15b-47a5-9938-1284f1860a00 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:49.088019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc3fd6ea-c15b-47a5-9938-1284f1860a00 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:49.088474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc3fd6ea-c15b-47a5-9938-1284f1860a00 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:49.089248 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc3fd6ea-c15b-47a5-9938-1284f1860a00 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:49.089687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc3fd6ea-c15b-47a5-9938-1284f1860a00 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:49.312344 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bc3fd6ea-c15b-47a5-9938-1284f1860a00 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:49.324051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bc3fd6ea-c15b-47a5-9938-1284f1860a00 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1552 microversion: 2.1 time: 0.248683 Aug 02 09:07:49.334283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 115/230] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:49 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1552 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:49.475870 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-77c29449-f934-4514-ad2f-fb6377016e4a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:49.480065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-77c29449-f934-4514-ad2f-fb6377016e4a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:49.486246 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77c29449-f934-4514-ad2f-fb6377016e4a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:49.487123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77c29449-f934-4514-ad2f-fb6377016e4a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:49.488868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77c29449-f934-4514-ad2f-fb6377016e4a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:49.489635 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77c29449-f934-4514-ad2f-fb6377016e4a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:49.675008 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-77c29449-f934-4514-ad2f-fb6377016e4a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:49.684729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-77c29449-f934-4514-ad2f-fb6377016e4a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.214037 Aug 02 09:07:49.685422 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 116/231] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:49 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:50.359485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-220c2c6d-5129-421a-beed-4bcc99f12cf4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:50.361738 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-220c2c6d-5129-421a-beed-4bcc99f12cf4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:50.388297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-220c2c6d-5129-421a-beed-4bcc99f12cf4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:50.390590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-220c2c6d-5129-421a-beed-4bcc99f12cf4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:50.395052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-220c2c6d-5129-421a-beed-4bcc99f12cf4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:50.407477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-220c2c6d-5129-421a-beed-4bcc99f12cf4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:50.681535 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-220c2c6d-5129-421a-beed-4bcc99f12cf4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:50.699540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-220c2c6d-5129-421a-beed-4bcc99f12cf4 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1552 microversion: 2.1 time: 0.349029 Aug 02 09:07:50.701923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 116/232] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:50 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1552 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:50.707151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9c261d78-3691-4b20-a11f-a6bb805b4491 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:50.708378 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9c261d78-3691-4b20-a11f-a6bb805b4491 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:50.715876 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9c261d78-3691-4b20-a11f-a6bb805b4491 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:50.723584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9c261d78-3691-4b20-a11f-a6bb805b4491 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:50.731880 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9c261d78-3691-4b20-a11f-a6bb805b4491 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:50.734034 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9c261d78-3691-4b20-a11f-a6bb805b4491 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:50.999254 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9c261d78-3691-4b20-a11f-a6bb805b4491 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:51.013684 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9c261d78-3691-4b20-a11f-a6bb805b4491 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.310541 Aug 02 09:07:51.017688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 117/233] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:50 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:51.722039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-53d8b991-6ca5-48a7-a193-be4a6f66a078 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:51.723067 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-53d8b991-6ca5-48a7-a193-be4a6f66a078 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:51.731238 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53d8b991-6ca5-48a7-a193-be4a6f66a078 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:51.732081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53d8b991-6ca5-48a7-a193-be4a6f66a078 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:51.733610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53d8b991-6ca5-48a7-a193-be4a6f66a078 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:51.734455 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53d8b991-6ca5-48a7-a193-be4a6f66a078 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:52.029279 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-53d8b991-6ca5-48a7-a193-be4a6f66a078 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:52.039046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-53d8b991-6ca5-48a7-a193-be4a6f66a078 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1552 microversion: 2.1 time: 0.320795 Aug 02 09:07:52.039416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-616da411-e4bd-4e17-9f9d-784f6bbb7b43 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:52.039924 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 117/234] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:51 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1552 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:52.046719 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-616da411-e4bd-4e17-9f9d-784f6bbb7b43 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:52.060876 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-616da411-e4bd-4e17-9f9d-784f6bbb7b43 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:52.064868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-616da411-e4bd-4e17-9f9d-784f6bbb7b43 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:52.067356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-616da411-e4bd-4e17-9f9d-784f6bbb7b43 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:52.068507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-616da411-e4bd-4e17-9f9d-784f6bbb7b43 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:52.287018 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-616da411-e4bd-4e17-9f9d-784f6bbb7b43 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:52.295998 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-616da411-e4bd-4e17-9f9d-784f6bbb7b43 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.262884 Aug 02 09:07:52.309933 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 118/235] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:52 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:52.527973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-2a92d2af-3474-4f91-a3e5-b5bf30d7427a req-f21c5e2d-6b5b-40ba-b2f5-70bd9442c29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64dc045-cfe6-4e8f-8ead-9304350b0748", "name": "network-vif-deleted", "tag": "696e0051-f163-4b40-a6e4-bab5666ab4a9"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:52.538991 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-2a92d2af-3474-4f91-a3e5-b5bf30d7427a req-f21c5e2d-6b5b-40ba-b2f5-70bd9442c29d service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:52.539436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-2a92d2af-3474-4f91-a3e5-b5bf30d7427a req-f21c5e2d-6b5b-40ba-b2f5-70bd9442c29d service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:52.580120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-2a92d2af-3474-4f91-a3e5-b5bf30d7427a req-f21c5e2d-6b5b-40ba-b2f5-70bd9442c29d service nova] Creating event network-vif-deleted:696e0051-f163-4b40-a6e4-bab5666ab4a9 for instance f64dc045-cfe6-4e8f-8ead-9304350b0748 on hv-cinder-84713 Aug 02 09:07:52.590433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-2a92d2af-3474-4f91-a3e5-b5bf30d7427a req-f21c5e2d-6b5b-40ba-b2f5-70bd9442c29d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065907 Aug 02 09:07:52.594073 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 118/236] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:53.061121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-66ba1c41-3d84-4038-9b98-acde2929c4c6 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:53.061682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-66ba1c41-3d84-4038-9b98-acde2929c4c6 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:53.069124 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-66ba1c41-3d84-4038-9b98-acde2929c4c6 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:53.069570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-66ba1c41-3d84-4038-9b98-acde2929c4c6 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:53.070383 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-66ba1c41-3d84-4038-9b98-acde2929c4c6 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:53.070826 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-66ba1c41-3d84-4038-9b98-acde2929c4c6 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:53.096053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:53.161066 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-66ba1c41-3d84-4038-9b98-acde2929c4c6 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:53.171451 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-66ba1c41-3d84-4038-9b98-acde2929c4c6 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1345 microversion: 2.1 time: 0.114247 Aug 02 09:07:53.172145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 119/237] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:53 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:53.319467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-067746e7-2113-4bda-be3c-c232b6ba4264 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:53.320077 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-067746e7-2113-4bda-be3c-c232b6ba4264 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:53.327130 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-067746e7-2113-4bda-be3c-c232b6ba4264 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:53.327603 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-067746e7-2113-4bda-be3c-c232b6ba4264 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:53.328386 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-067746e7-2113-4bda-be3c-c232b6ba4264 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:53.328807 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-067746e7-2113-4bda-be3c-c232b6ba4264 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:53.468863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-067746e7-2113-4bda-be3c-c232b6ba4264 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:53.476562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-067746e7-2113-4bda-be3c-c232b6ba4264 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.162670 Aug 02 09:07:53.477629 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 119/238] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:53 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:54.194833 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:54.197385 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:54.206526 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:54.212614 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:54.216151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:54.216816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:54.265429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:54.266194 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:54.267045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lazy-loading 'fault' on Instance uuid f64dc045-cfe6-4e8f-8ead-9304350b0748 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:07:54.323969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9d9cfdcaac473786d3017f73163274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b198992cc0014c6a9c25374d24fb01a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:54.335251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0f389e80-6ec4-42fe-93d8-750ae9660d25 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 200 len: 1350 microversion: 2.1 time: 0.144892 Aug 02 09:07:54.335801 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 120/239] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:54 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:54.502774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b2171727-38e2-470a-9f28-124c5101ea91 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:54.503470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b2171727-38e2-470a-9f28-124c5101ea91 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:54.510449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b2171727-38e2-470a-9f28-124c5101ea91 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:54.512958 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b2171727-38e2-470a-9f28-124c5101ea91 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:54.512958 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b2171727-38e2-470a-9f28-124c5101ea91 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:54.512958 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b2171727-38e2-470a-9f28-124c5101ea91 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:54.676952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b2171727-38e2-470a-9f28-124c5101ea91 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:54.693624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b2171727-38e2-470a-9f28-124c5101ea91 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.195058 Aug 02 09:07:54.694239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 120/240] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:54 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:54.821718 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9d84e559-782f-4959-91a0-96008fc48625 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Action: 'create', calling method: .version_select at 0x7f0f2da76430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1453616988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrB+Ipr2p3T7Xpia2kb7HjSB/mkkwIO114al3JjFvDwijdgM4Ynkxcqh0XhLtgzELIABw9+/Uju7djsq7ldBWbkNoPujI8+HF+vioMaCVkHGClqgYWO4ImC+yQiC9X6Ew=="}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:54.843655 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-9d84e559-782f-4959-91a0-96008fc48625 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Getting quotas for project 5132918a404e4b6ab13577698e319630. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:07:54.849760 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-9d84e559-782f-4959-91a0-96008fc48625 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Getting quotas for user 8b2daf470f45422a8c1bd5cf62efdd9e and project 5132918a404e4b6ab13577698e319630. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:07:55.014885 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9d84e559-782f-4959-91a0-96008fc48625 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.199497 Aug 02 09:07:55.020262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 121/241] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:07:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:07:55.143447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1309413611", "imageRef": "4e7ff361-fe13-4eaf-bdfa-c7a6aecd542c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1453616988", "networks": [{"uuid": "ab101263-573c-4b46-90a1-a2e92e2dc49c"}]}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:55.203876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] validate_networks() for [('ab101263-573c-4b46-90a1-a2e92e2dc49c', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:07:55.360755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:55.362100 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:55.372604 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:55.378011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:55.378011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:55.378011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:55.395292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] HTTP exception thrown: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Request method failure captured: Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 HTTP/1.1 Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkZe7V0ktvMVskygWKlYMlXWjYhFZe-589kOlGWZglsEEbJDdH_BkNyFx0j6tlxt9WTX3i8AZosUm23aHIvDs9dlcFEIun8KW7AdTba5intZcQSWbV5KAP2k-55B2oflXdTr-6caYGwGZ2VNXCDrj0gxP0uBhCSGtyti9Tquvhb5tE Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b198992cc0014c6a9c25374d24fb01a9 Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:07:55.403405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b198992cc0014c6a9c25374d24fb01a9 Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-DeleteServersTestJSON-1692780489-project Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 3b9d9cfdcaac473786d3017f73163274 Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-DeleteServersTestJSON-1692780489-project Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.415277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'f64dc045-cfe6-4e8f-8ead-9304350b0748'} Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:07:55.417121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.419366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.421353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Returning 404 to user: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:07:55.421353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6accd5f3-2f53-4a69-9993-bd06786b6084 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 404 len: 111 microversion: 2.1 time: 0.053091 Aug 02 09:07:55.421353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 122/242] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:55 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:07:55.579693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:55.582832 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:55.590295 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:55.590295 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:55.591406 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:55.591775 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:55.606479 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] HTTP exception thrown: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Request method failure captured: Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748/os-volume_attachments HTTP/1.1 Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkZe7V0ktvMVskygWKlYMlXWjYhFZe-589kOlGWZglsEEbJDdH_BkNyFx0j6tlxt9WTX3i8AZosUm23aHIvDs9dlcFEIun8KW7AdTba5intZcQSWbV5KAP2k-55B2oflXdTr-6caYGwGZ2VNXCDrj0gxP0uBhCSGtyti9Tquvhb5tE Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b198992cc0014c6a9c25374d24fb01a9 Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:07:55.608637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b198992cc0014c6a9c25374d24fb01a9 Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-DeleteServersTestJSON-1692780489-project Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 3b9d9cfdcaac473786d3017f73163274 Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-DeleteServersTestJSON-1692780489-project Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.610027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'server_id': 'f64dc045-cfe6-4e8f-8ead-9304350b0748'} Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:07:55.610697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:55.611732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:55.613309 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Returning 404 to user: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:07:55.614245 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-07338a28-6445-4cfd-90ac-a2b2f46ede82 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040331 Aug 02 09:07:55.614964 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 123/243] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:07:55 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:07:55.718225 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1553ec43-82da-45e6-8adb-93ffab8aefb5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:55.720125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1553ec43-82da-45e6-8adb-93ffab8aefb5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:55.729392 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1553ec43-82da-45e6-8adb-93ffab8aefb5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:55.730529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1553ec43-82da-45e6-8adb-93ffab8aefb5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:55.731781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1553ec43-82da-45e6-8adb-93ffab8aefb5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:55.732512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1553ec43-82da-45e6-8adb-93ffab8aefb5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:55.820652 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:07:55.822087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:07:55.822778 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:07:55.823284 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:07:55.824013 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:07:55.835634 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:55.836104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:55.837123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:55.837559 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:55.871799 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Getting quotas for project 5132918a404e4b6ab13577698e319630. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:07:55.878217 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Getting quotas for user 8b2daf470f45422a8c1bd5cf62efdd9e and project 5132918a404e4b6ab13577698e319630. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:07:55.902470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:07:55.905320 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4e7ff361-fe13-4eaf-bdfa-c7a6aecd542c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:07:55.927126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1553ec43-82da-45e6-8adb-93ffab8aefb5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:55.933032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1553ec43-82da-45e6-8adb-93ffab8aefb5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.219773 Aug 02 09:07:55.947263 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 124/244] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:55 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:56.060774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bba6ca0d-e2a6-4689-bcfd-fa8b870a3bc3 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921233 Aug 02 09:07:56.061648 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 121/245] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:07:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:07:56.073866 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c2a65cc6-217c-4f41-bef5-8c9b8f04d279 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:56.074949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c2a65cc6-217c-4f41-bef5-8c9b8f04d279 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:56.139434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c2a65cc6-217c-4f41-bef5-8c9b8f04d279 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:56.150414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c2a65cc6-217c-4f41-bef5-8c9b8f04d279 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1259 microversion: 2.1 time: 0.080972 Aug 02 09:07:56.168960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 125/246] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:56 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1259 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:56.955142 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1d84baf2-751e-4dc3-a8f3-a9645d1335e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:56.955841 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1d84baf2-751e-4dc3-a8f3-a9645d1335e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:56.963632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1d84baf2-751e-4dc3-a8f3-a9645d1335e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:56.964078 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1d84baf2-751e-4dc3-a8f3-a9645d1335e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:56.964846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1d84baf2-751e-4dc3-a8f3-a9645d1335e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:56.965278 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1d84baf2-751e-4dc3-a8f3-a9645d1335e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:57.080332 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:57.080851 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:57.088321 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:57.089436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:57.089436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:57.090597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:57.104857 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] HTTP exception thrown: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Request method failure captured: Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 HTTP/1.1 Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkZe7V0ktvMVskygWKlYMlXWjYhFZe-589kOlGWZglsEEbJDdH_BkNyFx0j6tlxt9WTX3i8AZosUm23aHIvDs9dlcFEIun8KW7AdTba5intZcQSWbV5KAP2k-55B2oflXdTr-6caYGwGZ2VNXCDrj0gxP0uBhCSGtyti9Tquvhb5tE Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b198992cc0014c6a9c25374d24fb01a9 Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:07:57.106450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b198992cc0014c6a9c25374d24fb01a9 Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-DeleteServersTestJSON-1692780489-project Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 3b9d9cfdcaac473786d3017f73163274 Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-DeleteServersTestJSON-1692780489-project Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.107957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'f64dc045-cfe6-4e8f-8ead-9304350b0748'} Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:07:57.108957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.111199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.114251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Returning 404 to user: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:07:57.114251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-075eaa28-67bd-4b4a-a957-d73c0ec725b8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 404 len: 111 microversion: 2.1 time: 0.031785 Aug 02 09:07:57.114251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 126/247] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:07:57 2022] DELETE /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:07:57.116659 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:57.117282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] [instance: f64dc045-cfe6-4e8f-8ead-9304350b0748] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:57.126305 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:57.126305 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:57.127150 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:57.127488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:57.145112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1d84baf2-751e-4dc3-a8f3-a9645d1335e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:57.150715 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] HTTP exception thrown: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Request method failure captured: Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 HTTP/1.1 Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkZe7V0ktvMVskygWKlYMlXWjYhFZe-589kOlGWZglsEEbJDdH_BkNyFx0j6tlxt9WTX3i8AZosUm23aHIvDs9dlcFEIun8KW7AdTba5intZcQSWbV5KAP2k-55B2oflXdTr-6caYGwGZ2VNXCDrj0gxP0uBhCSGtyti9Tquvhb5tE Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b198992cc0014c6a9c25374d24fb01a9 Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:07:57.152593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b198992cc0014c6a9c25374d24fb01a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b198992cc0014c6a9c25374d24fb01a9 Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1692780489 Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-DeleteServersTestJSON-1692780489-project Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 3b9d9cfdcaac473786d3017f73163274 Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-DeleteServersTestJSON-1692780489-project Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.154153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'f64dc045-cfe6-4e8f-8ead-9304350b0748'} Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:07:57.154974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. Aug 02 09:07:57.156818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:07:57.158108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1d84baf2-751e-4dc3-a8f3-a9645d1335e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.202696 Aug 02 09:07:57.158108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 122/248] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:56 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:57.158373 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] Returning 404 to user: Instance f64dc045-cfe6-4e8f-8ead-9304350b0748 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:07:57.158373 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5689750e-2c96-4851-a1d8-422874fd8ea8 tempest-DeleteServersTestJSON-1692780489 tempest-DeleteServersTestJSON-1692780489-project] 10.222.0.46 "GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748" status: 404 len: 111 microversion: 2.1 time: 0.043194 Aug 02 09:07:57.158373 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 127/249] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:57 2022] GET /compute/v2.1/servers/f64dc045-cfe6-4e8f-8ead-9304350b0748 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:07:57.178000 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-847e88b3-8a54-4d32-a296-74ebaaff69c0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:57.179495 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-847e88b3-8a54-4d32-a296-74ebaaff69c0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:57.289150 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-847e88b3-8a54-4d32-a296-74ebaaff69c0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:57.299526 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-847e88b3-8a54-4d32-a296-74ebaaff69c0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1259 microversion: 2.1 time: 0.127841 Aug 02 09:07:57.326334 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 123/250] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:57 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:58.189343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ae74ee79-aac6-43b4-bf51-0f16b2d08133 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:58.190749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ae74ee79-aac6-43b4-bf51-0f16b2d08133 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:58.198360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae74ee79-aac6-43b4-bf51-0f16b2d08133 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:58.199212 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae74ee79-aac6-43b4-bf51-0f16b2d08133 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:58.200302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae74ee79-aac6-43b4-bf51-0f16b2d08133 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:58.201193 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae74ee79-aac6-43b4-bf51-0f16b2d08133 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:58.338377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-652fc06b-4155-4068-9c9f-4cc2d8d48da1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:58.340300 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-652fc06b-4155-4068-9c9f-4cc2d8d48da1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:58.369151 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-652fc06b-4155-4068-9c9f-4cc2d8d48da1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:58.369783 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-652fc06b-4155-4068-9c9f-4cc2d8d48da1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:58.370760 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-652fc06b-4155-4068-9c9f-4cc2d8d48da1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:58.371329 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-652fc06b-4155-4068-9c9f-4cc2d8d48da1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:58.456615 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ae74ee79-aac6-43b4-bf51-0f16b2d08133 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:58.480418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ae74ee79-aac6-43b4-bf51-0f16b2d08133 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.295511 Aug 02 09:07:58.481389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 128/251] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:58 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:58.507450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-652fc06b-4155-4068-9c9f-4cc2d8d48da1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:58.523272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-652fc06b-4155-4068-9c9f-4cc2d8d48da1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1311 microversion: 2.1 time: 0.191995 Aug 02 09:07:58.524115 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 124/252] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:58 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1311 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:07:59.502481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-bdd86e5f-638e-41a4-910e-a4d5e55c76a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:59.503085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-bdd86e5f-638e-41a4-910e-a4d5e55c76a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:59.519217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bdd86e5f-638e-41a4-910e-a4d5e55c76a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:59.519977 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bdd86e5f-638e-41a4-910e-a4d5e55c76a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:59.520797 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bdd86e5f-638e-41a4-910e-a4d5e55c76a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:59.521235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bdd86e5f-638e-41a4-910e-a4d5e55c76a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:59.552986 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f674d5b0-d264-4757-be2c-e6ea374b80aa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:07:59.553609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f674d5b0-d264-4757-be2c-e6ea374b80aa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:07:59.561347 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f674d5b0-d264-4757-be2c-e6ea374b80aa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:59.572146 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f674d5b0-d264-4757-be2c-e6ea374b80aa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:59.573019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f674d5b0-d264-4757-be2c-e6ea374b80aa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:07:59.573474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f674d5b0-d264-4757-be2c-e6ea374b80aa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:07:59.772207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f674d5b0-d264-4757-be2c-e6ea374b80aa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:59.784939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f674d5b0-d264-4757-be2c-e6ea374b80aa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1317 microversion: 2.1 time: 0.234372 Aug 02 09:07:59.785562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 125/253] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:59 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:07:59.858533 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bdd86e5f-638e-41a4-910e-a4d5e55c76a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:07:59.873413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-bdd86e5f-638e-41a4-910e-a4d5e55c76a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.375124 Aug 02 09:07:59.876975 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-699481131", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "networks": [{"uuid": "d5afca6f-34e9-4113-b8e9-ded5c8c20b76"}]}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:07:59.878195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 129/254] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:07:59 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:00.007070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] validate_networks() for [('d5afca6f-34e9-4113-b8e9-ded5c8c20b76', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:08:00.815752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2b64f8fd-62b9-4e09-a283-48756469b64f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:00.818190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2b64f8fd-62b9-4e09-a283-48756469b64f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:00.832307 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2b64f8fd-62b9-4e09-a283-48756469b64f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:00.832984 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2b64f8fd-62b9-4e09-a283-48756469b64f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:00.834213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2b64f8fd-62b9-4e09-a283-48756469b64f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:00.834909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2b64f8fd-62b9-4e09-a283-48756469b64f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:00.976481 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:08:00.977052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:08:00.977388 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:08:00.979086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:08:00.982282 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:08:01.003564 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:01.005272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:01.009367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:01.011483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:01.063970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Getting quotas for project 76cc762f121e46c096aaca327258258c. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:08:01.082284 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Getting quotas for user f1fd384cbf4943368ee57e868c37d92c and project 76cc762f121e46c096aaca327258258c. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:08:01.118575 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:08:01.141370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:08:01.534388 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-888ebfe2-f908-4810-93ca-5c9f5f301359 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661119 Aug 02 09:08:01.538267 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 126/255] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:08:01.550605 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8ddf63aa-8f41-4888-b615-fc44c618c02b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:01.552883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8ddf63aa-8f41-4888-b615-fc44c618c02b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:01.566399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ddf63aa-8f41-4888-b615-fc44c618c02b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:01.567070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ddf63aa-8f41-4888-b615-fc44c618c02b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:01.568153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ddf63aa-8f41-4888-b615-fc44c618c02b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:01.568752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ddf63aa-8f41-4888-b615-fc44c618c02b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:01.961190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2b64f8fd-62b9-4e09-a283-48756469b64f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:01.981455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2b64f8fd-62b9-4e09-a283-48756469b64f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 1.175370 Aug 02 09:08:01.982071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 130/256] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:00 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:01.986808 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d4a361db-da96-4a51-a2e8-aaf2067210b5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:01.991604 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d4a361db-da96-4a51-a2e8-aaf2067210b5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:02.068238 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8ddf63aa-8f41-4888-b615-fc44c618c02b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:02.075923 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d4a361db-da96-4a51-a2e8-aaf2067210b5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:02.089773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d4a361db-da96-4a51-a2e8-aaf2067210b5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1218 microversion: 2.1 time: 0.102832 Aug 02 09:08:02.090595 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 131/257] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:01 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:02.093268 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8ddf63aa-8f41-4888-b615-fc44c618c02b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.553614 Aug 02 09:08:02.094933 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 127/258] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:01 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:03.010191 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f6a058cf-68d5-47ac-8f54-a4398ea12339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:03.014606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f6a058cf-68d5-47ac-8f54-a4398ea12339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:03.054855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f6a058cf-68d5-47ac-8f54-a4398ea12339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:03.059016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f6a058cf-68d5-47ac-8f54-a4398ea12339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:03.061799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f6a058cf-68d5-47ac-8f54-a4398ea12339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:03.064521 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f6a058cf-68d5-47ac-8f54-a4398ea12339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:03.120274 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9d97e5a8-e620-4804-a2d7-3e22ab6a8042 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:03.121177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9d97e5a8-e620-4804-a2d7-3e22ab6a8042 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:03.150709 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d97e5a8-e620-4804-a2d7-3e22ab6a8042 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:03.153218 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d97e5a8-e620-4804-a2d7-3e22ab6a8042 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:03.156319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d97e5a8-e620-4804-a2d7-3e22ab6a8042 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:03.166274 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d97e5a8-e620-4804-a2d7-3e22ab6a8042 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:03.517842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f6a058cf-68d5-47ac-8f54-a4398ea12339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:03.545282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f6a058cf-68d5-47ac-8f54-a4398ea12339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.537736 Aug 02 09:08:03.545282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 132/259] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:03 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:03.566279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-be52ce5f-787d-499c-854d-25e8b4943dee tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:03.567420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-be52ce5f-787d-499c-854d-25e8b4943dee tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:03.594973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-be52ce5f-787d-499c-854d-25e8b4943dee tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:03.603498 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-be52ce5f-787d-499c-854d-25e8b4943dee tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:03.605142 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-be52ce5f-787d-499c-854d-25e8b4943dee tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:03.605735 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-be52ce5f-787d-499c-854d-25e8b4943dee tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:03.753238 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-be52ce5f-787d-499c-854d-25e8b4943dee tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:03.765530 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-be52ce5f-787d-499c-854d-25e8b4943dee tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1222 microversion: 2.1 time: 0.218410 Aug 02 09:08:03.766421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 133/260] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:03 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1222 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:03.795726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-40cafbbd-2dc9-4ce1-a2c4-6fbf718fd373 req-74a535a8-e2c7-4270-b2fc-cf50b608acad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9b683c-91dd-41ab-a9ee-45c9af6dc89b", "tag": "c42abcac-01a1-4142-811d-f1eb28ab8e79"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:08:03.814591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-40cafbbd-2dc9-4ce1-a2c4-6fbf718fd373 req-74a535a8-e2c7-4270-b2fc-cf50b608acad service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:03.818639 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-40cafbbd-2dc9-4ce1-a2c4-6fbf718fd373 req-74a535a8-e2c7-4270-b2fc-cf50b608acad service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:03.845361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-40cafbbd-2dc9-4ce1-a2c4-6fbf718fd373 req-74a535a8-e2c7-4270-b2fc-cf50b608acad service nova] Creating event network-changed:c42abcac-01a1-4142-811d-f1eb28ab8e79 for instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b on hv-cinder-84713 Aug 02 09:08:03.870453 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9d97e5a8-e620-4804-a2d7-3e22ab6a8042 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:03.872612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-40cafbbd-2dc9-4ce1-a2c4-6fbf718fd373 req-74a535a8-e2c7-4270-b2fc-cf50b608acad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085802 Aug 02 09:08:03.881116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 134/261] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:03.890458 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9d97e5a8-e620-4804-a2d7-3e22ab6a8042 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.774681 Aug 02 09:08:03.906461 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 128/262] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:03 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:04.579715 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-955756fd-65a5-4bab-8005-6f3ed9c3ba5f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:04.580776 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-955756fd-65a5-4bab-8005-6f3ed9c3ba5f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:04.591227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-955756fd-65a5-4bab-8005-6f3ed9c3ba5f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:04.592236 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-955756fd-65a5-4bab-8005-6f3ed9c3ba5f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:04.592766 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-955756fd-65a5-4bab-8005-6f3ed9c3ba5f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:04.593201 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-955756fd-65a5-4bab-8005-6f3ed9c3ba5f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:04.771900 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-955756fd-65a5-4bab-8005-6f3ed9c3ba5f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:04.781035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-955756fd-65a5-4bab-8005-6f3ed9c3ba5f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.206364 Aug 02 09:08:04.781641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 135/263] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:04 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:04.800887 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2b85e63b-6c7d-4347-932a-45291ad5ca1d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:04.801481 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2b85e63b-6c7d-4347-932a-45291ad5ca1d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:04.809382 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b85e63b-6c7d-4347-932a-45291ad5ca1d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:04.809833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b85e63b-6c7d-4347-932a-45291ad5ca1d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:04.810839 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b85e63b-6c7d-4347-932a-45291ad5ca1d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:04.811167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b85e63b-6c7d-4347-932a-45291ad5ca1d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:04.899381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2b85e63b-6c7d-4347-932a-45291ad5ca1d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:04.908627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2b85e63b-6c7d-4347-932a-45291ad5ca1d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.115734 Aug 02 09:08:04.909440 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 129/264] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:04 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:04.937715 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-23ae4a2f-f2d6-41ff-8d6e-234d5f51c75a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:04.938441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-23ae4a2f-f2d6-41ff-8d6e-234d5f51c75a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:04.944876 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23ae4a2f-f2d6-41ff-8d6e-234d5f51c75a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:04.945513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23ae4a2f-f2d6-41ff-8d6e-234d5f51c75a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:04.947312 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23ae4a2f-f2d6-41ff-8d6e-234d5f51c75a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:04.947745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23ae4a2f-f2d6-41ff-8d6e-234d5f51c75a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:05.084266 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-23ae4a2f-f2d6-41ff-8d6e-234d5f51c75a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:05.092704 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-23ae4a2f-f2d6-41ff-8d6e-234d5f51c75a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.159553 Aug 02 09:08:05.093214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 136/265] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:04 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:05.804771 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-53249719-82ef-43ea-839d-5d03ab8a54ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:05.806208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-53249719-82ef-43ea-839d-5d03ab8a54ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:05.812756 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53249719-82ef-43ea-839d-5d03ab8a54ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:05.813199 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53249719-82ef-43ea-839d-5d03ab8a54ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:05.814262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53249719-82ef-43ea-839d-5d03ab8a54ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:05.814735 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53249719-82ef-43ea-839d-5d03ab8a54ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:05.936270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-56c159aa-7e2f-4adf-8120-577f1e74cb33 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:05.937677 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-56c159aa-7e2f-4adf-8120-577f1e74cb33 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:05.945678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56c159aa-7e2f-4adf-8120-577f1e74cb33 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:05.946484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56c159aa-7e2f-4adf-8120-577f1e74cb33 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:05.947749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56c159aa-7e2f-4adf-8120-577f1e74cb33 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:05.948552 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56c159aa-7e2f-4adf-8120-577f1e74cb33 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:05.993599 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-53249719-82ef-43ea-839d-5d03ab8a54ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:06.003684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-53249719-82ef-43ea-839d-5d03ab8a54ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.202794 Aug 02 09:08:06.004752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 130/266] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:05 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:06.037943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-56c159aa-7e2f-4adf-8120-577f1e74cb33 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:06.053042 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-56c159aa-7e2f-4adf-8120-577f1e74cb33 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.125273 Aug 02 09:08:06.066665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 137/267] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:05 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:06.120367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cb8aedaa-c0ac-4b41-a66f-eba837aea3e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:06.120976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cb8aedaa-c0ac-4b41-a66f-eba837aea3e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:06.127779 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb8aedaa-c0ac-4b41-a66f-eba837aea3e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:06.128219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb8aedaa-c0ac-4b41-a66f-eba837aea3e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:06.128996 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb8aedaa-c0ac-4b41-a66f-eba837aea3e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:06.129429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb8aedaa-c0ac-4b41-a66f-eba837aea3e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:06.366351 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cb8aedaa-c0ac-4b41-a66f-eba837aea3e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:06.374511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cb8aedaa-c0ac-4b41-a66f-eba837aea3e9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.258695 Aug 02 09:08:06.375088 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 131/268] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:06 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:07.027056 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5bc7b429-86b2-4aaf-9b07-a223fbf69102 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:07.027678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5bc7b429-86b2-4aaf-9b07-a223fbf69102 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:07.035631 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5bc7b429-86b2-4aaf-9b07-a223fbf69102 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:07.036360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5bc7b429-86b2-4aaf-9b07-a223fbf69102 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:07.037297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5bc7b429-86b2-4aaf-9b07-a223fbf69102 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:07.037911 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5bc7b429-86b2-4aaf-9b07-a223fbf69102 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:07.083646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-06c5de71-4172-4f22-9fe5-1baedfde7c75 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:07.087727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-06c5de71-4172-4f22-9fe5-1baedfde7c75 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:07.095553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-06c5de71-4172-4f22-9fe5-1baedfde7c75 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:07.096138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-06c5de71-4172-4f22-9fe5-1baedfde7c75 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:07.096984 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-06c5de71-4172-4f22-9fe5-1baedfde7c75 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:07.097487 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-06c5de71-4172-4f22-9fe5-1baedfde7c75 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:07.163975 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-06c5de71-4172-4f22-9fe5-1baedfde7c75 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:07.172470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-06c5de71-4172-4f22-9fe5-1baedfde7c75 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.097123 Aug 02 09:08:07.175945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 132/269] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:07 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:07.202573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5bc7b429-86b2-4aaf-9b07-a223fbf69102 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:07.211813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5bc7b429-86b2-4aaf-9b07-a223fbf69102 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.188619 Aug 02 09:08:07.212495 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 138/270] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:07 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:07.407419 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9d360197-70cd-4a83-ab07-165ca00c05c0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:07.408882 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9d360197-70cd-4a83-ab07-165ca00c05c0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:07.416780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d360197-70cd-4a83-ab07-165ca00c05c0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:07.417592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d360197-70cd-4a83-ab07-165ca00c05c0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:07.418508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d360197-70cd-4a83-ab07-165ca00c05c0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:07.419033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d360197-70cd-4a83-ab07-165ca00c05c0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:07.442668 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:07.608104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9d360197-70cd-4a83-ab07-165ca00c05c0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:07.615979 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9d360197-70cd-4a83-ab07-165ca00c05c0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.212484 Aug 02 09:08:07.616554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 133/271] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:07 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:08.194858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e0c20c9d-066a-482f-8a47-cea9c264560d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:08.196171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e0c20c9d-066a-482f-8a47-cea9c264560d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:08.204627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e0c20c9d-066a-482f-8a47-cea9c264560d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:08.205986 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e0c20c9d-066a-482f-8a47-cea9c264560d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:08.207726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e0c20c9d-066a-482f-8a47-cea9c264560d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:08.209792 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e0c20c9d-066a-482f-8a47-cea9c264560d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:08.236864 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-de37a308-e47c-476b-9655-89c16971d82e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:08.237832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-de37a308-e47c-476b-9655-89c16971d82e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:08.250474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de37a308-e47c-476b-9655-89c16971d82e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:08.251287 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de37a308-e47c-476b-9655-89c16971d82e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:08.253086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de37a308-e47c-476b-9655-89c16971d82e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:08.254006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de37a308-e47c-476b-9655-89c16971d82e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:08.468258 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-de37a308-e47c-476b-9655-89c16971d82e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:08.485036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-de37a308-e47c-476b-9655-89c16971d82e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.249142 Aug 02 09:08:08.485036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 134/272] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:08 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:08.490656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e0c20c9d-066a-482f-8a47-cea9c264560d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:08.500355 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e0c20c9d-066a-482f-8a47-cea9c264560d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.310046 Aug 02 09:08:08.501920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 139/273] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:08 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:08.637469 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-11286b43-748e-4669-adc5-bd75aaf9a74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:08.638271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-11286b43-748e-4669-adc5-bd75aaf9a74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:08.644953 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11286b43-748e-4669-adc5-bd75aaf9a74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:08.645666 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11286b43-748e-4669-adc5-bd75aaf9a74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:08.646602 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11286b43-748e-4669-adc5-bd75aaf9a74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:08.647114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11286b43-748e-4669-adc5-bd75aaf9a74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:08.791381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-11286b43-748e-4669-adc5-bd75aaf9a74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:08.799180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-11286b43-748e-4669-adc5-bd75aaf9a74c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.165642 Aug 02 09:08:08.809186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 135/274] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:08 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:09.509394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c43726fe-0fc5-4925-8424-214d2f42c66f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:09.510035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c43726fe-0fc5-4925-8424-214d2f42c66f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:09.524509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5e318c46-e922-4acf-94c7-7bee89a8dc66 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:09.525233 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5e318c46-e922-4acf-94c7-7bee89a8dc66 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:09.529711 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c43726fe-0fc5-4925-8424-214d2f42c66f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:09.531068 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c43726fe-0fc5-4925-8424-214d2f42c66f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:09.532919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c43726fe-0fc5-4925-8424-214d2f42c66f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:09.535392 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c43726fe-0fc5-4925-8424-214d2f42c66f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:09.542992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e318c46-e922-4acf-94c7-7bee89a8dc66 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:09.543803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e318c46-e922-4acf-94c7-7bee89a8dc66 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:09.546441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e318c46-e922-4acf-94c7-7bee89a8dc66 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:09.547128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e318c46-e922-4acf-94c7-7bee89a8dc66 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:09.669715 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5e318c46-e922-4acf-94c7-7bee89a8dc66 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:09.691387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5e318c46-e922-4acf-94c7-7bee89a8dc66 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.172817 Aug 02 09:08:09.692171 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 136/275] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:09 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:09.773414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c43726fe-0fc5-4925-8424-214d2f42c66f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:09.782308 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c43726fe-0fc5-4925-8424-214d2f42c66f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.277286 Aug 02 09:08:09.796044 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 140/276] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:09 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:09.822097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a5c003c3-d4ab-48eb-a575-1b3f58fe1690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:09.822713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a5c003c3-d4ab-48eb-a575-1b3f58fe1690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:09.833665 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a5c003c3-d4ab-48eb-a575-1b3f58fe1690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:09.834610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a5c003c3-d4ab-48eb-a575-1b3f58fe1690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:09.835323 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a5c003c3-d4ab-48eb-a575-1b3f58fe1690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:09.835978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a5c003c3-d4ab-48eb-a575-1b3f58fe1690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:09.980943 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a5c003c3-d4ab-48eb-a575-1b3f58fe1690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:09.989541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a5c003c3-d4ab-48eb-a575-1b3f58fe1690 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.172643 Aug 02 09:08:09.990136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 137/277] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:09 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:10.715856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-63ff82f6-90b5-47b0-93c7-a8a423a482e3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:10.716600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-63ff82f6-90b5-47b0-93c7-a8a423a482e3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:10.722892 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-63ff82f6-90b5-47b0-93c7-a8a423a482e3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:10.723330 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-63ff82f6-90b5-47b0-93c7-a8a423a482e3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:10.724107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-63ff82f6-90b5-47b0-93c7-a8a423a482e3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:10.724533 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-63ff82f6-90b5-47b0-93c7-a8a423a482e3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:10.787581 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-63ff82f6-90b5-47b0-93c7-a8a423a482e3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:10.795798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-63ff82f6-90b5-47b0-93c7-a8a423a482e3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.083779 Aug 02 09:08:10.796432 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 141/278] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:10 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:10.803633 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8ac140d0-047c-4ff0-b757-c92bf71f605f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:10.804236 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8ac140d0-047c-4ff0-b757-c92bf71f605f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:10.810828 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ac140d0-047c-4ff0-b757-c92bf71f605f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:10.811275 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ac140d0-047c-4ff0-b757-c92bf71f605f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:10.812048 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ac140d0-047c-4ff0-b757-c92bf71f605f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:10.812478 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ac140d0-047c-4ff0-b757-c92bf71f605f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:10.949567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8ac140d0-047c-4ff0-b757-c92bf71f605f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:10.957864 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8ac140d0-047c-4ff0-b757-c92bf71f605f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.157941 Aug 02 09:08:10.959028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 138/279] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:10 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:11.010933 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8cea555f-b9d6-40f3-8b10-753098dad893 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:11.011896 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8cea555f-b9d6-40f3-8b10-753098dad893 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:11.018591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8cea555f-b9d6-40f3-8b10-753098dad893 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:11.019312 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8cea555f-b9d6-40f3-8b10-753098dad893 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:11.020107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8cea555f-b9d6-40f3-8b10-753098dad893 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:11.026264 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8cea555f-b9d6-40f3-8b10-753098dad893 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:11.031957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:11.182071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8cea555f-b9d6-40f3-8b10-753098dad893 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:11.191725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8cea555f-b9d6-40f3-8b10-753098dad893 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.184673 Aug 02 09:08:11.192291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 142/280] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:11 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:11.818651 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-81a56f62-3b5a-4371-8a7e-9cd20d8c4664 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:11.818651 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-81a56f62-3b5a-4371-8a7e-9cd20d8c4664 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:11.819727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=4 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:11.821187 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=14 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:11.827847 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-81a56f62-3b5a-4371-8a7e-9cd20d8c4664 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:11.828294 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-81a56f62-3b5a-4371-8a7e-9cd20d8c4664 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:11.829063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-81a56f62-3b5a-4371-8a7e-9cd20d8c4664 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:11.829500 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-81a56f62-3b5a-4371-8a7e-9cd20d8c4664 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:11.902506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-81a56f62-3b5a-4371-8a7e-9cd20d8c4664 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:11.910362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-81a56f62-3b5a-4371-8a7e-9cd20d8c4664 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.097429 Aug 02 09:08:11.911168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 139/281] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:11 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:11.982881 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8a75c244-cd9f-4e13-a5f9-8b82ae1928e7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:11.986227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8a75c244-cd9f-4e13-a5f9-8b82ae1928e7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:11.990151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a75c244-cd9f-4e13-a5f9-8b82ae1928e7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:11.990665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a75c244-cd9f-4e13-a5f9-8b82ae1928e7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:11.991435 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a75c244-cd9f-4e13-a5f9-8b82ae1928e7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:11.991967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a75c244-cd9f-4e13-a5f9-8b82ae1928e7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:12.087148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=8 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:12.144762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8a75c244-cd9f-4e13-a5f9-8b82ae1928e7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:12.152381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8a75c244-cd9f-4e13-a5f9-8b82ae1928e7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.175959 Aug 02 09:08:12.153488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 143/282] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:11 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:12.212875 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9ade86b7-23cf-49fe-98bf-3d8dd3e28df3 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:12.213515 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9ade86b7-23cf-49fe-98bf-3d8dd3e28df3 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:12.220697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9ade86b7-23cf-49fe-98bf-3d8dd3e28df3 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:12.220697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9ade86b7-23cf-49fe-98bf-3d8dd3e28df3 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:12.220945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9ade86b7-23cf-49fe-98bf-3d8dd3e28df3 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:12.221362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9ade86b7-23cf-49fe-98bf-3d8dd3e28df3 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:12.361162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9ade86b7-23cf-49fe-98bf-3d8dd3e28df3 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:12.369168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9ade86b7-23cf-49fe-98bf-3d8dd3e28df3 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.160460 Aug 02 09:08:12.369751 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 140/283] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:12 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:12.942755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-290c455c-b6af-4672-a30e-4d8312f8c227 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:12.943200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-290c455c-b6af-4672-a30e-4d8312f8c227 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:12.951348 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-290c455c-b6af-4672-a30e-4d8312f8c227 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:12.953434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-290c455c-b6af-4672-a30e-4d8312f8c227 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:12.953434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-290c455c-b6af-4672-a30e-4d8312f8c227 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:12.953832 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-290c455c-b6af-4672-a30e-4d8312f8c227 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:13.035910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-290c455c-b6af-4672-a30e-4d8312f8c227 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:13.046689 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-290c455c-b6af-4672-a30e-4d8312f8c227 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.117103 Aug 02 09:08:13.052468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 144/284] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:12 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:13.175880 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-eac6549c-24d2-441b-9dfb-a15c25c01df6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:13.176426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-eac6549c-24d2-441b-9dfb-a15c25c01df6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:13.183921 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eac6549c-24d2-441b-9dfb-a15c25c01df6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:13.184372 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eac6549c-24d2-441b-9dfb-a15c25c01df6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:13.185181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eac6549c-24d2-441b-9dfb-a15c25c01df6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:13.185707 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eac6549c-24d2-441b-9dfb-a15c25c01df6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:13.357483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-eac6549c-24d2-441b-9dfb-a15c25c01df6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:13.370491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-eac6549c-24d2-441b-9dfb-a15c25c01df6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.193020 Aug 02 09:08:13.371310 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 141/285] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:13 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:13.390326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-84e68768-2dde-4c77-9d79-d1a0c713a7e6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:13.391690 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-84e68768-2dde-4c77-9d79-d1a0c713a7e6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:13.400220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-84e68768-2dde-4c77-9d79-d1a0c713a7e6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:13.400667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-84e68768-2dde-4c77-9d79-d1a0c713a7e6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:13.403359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-84e68768-2dde-4c77-9d79-d1a0c713a7e6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:13.403803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-84e68768-2dde-4c77-9d79-d1a0c713a7e6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:13.607368 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-84e68768-2dde-4c77-9d79-d1a0c713a7e6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:13.620248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-84e68768-2dde-4c77-9d79-d1a0c713a7e6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.232074 Aug 02 09:08:13.620248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 145/286] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:13 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:14.070325 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-813377be-6918-47fd-a0c0-8fdcc42f27d8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:14.071995 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-813377be-6918-47fd-a0c0-8fdcc42f27d8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:14.077381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-813377be-6918-47fd-a0c0-8fdcc42f27d8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:14.077858 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-813377be-6918-47fd-a0c0-8fdcc42f27d8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:14.078779 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-813377be-6918-47fd-a0c0-8fdcc42f27d8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:14.079189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-813377be-6918-47fd-a0c0-8fdcc42f27d8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:14.155988 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-813377be-6918-47fd-a0c0-8fdcc42f27d8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:14.163661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-813377be-6918-47fd-a0c0-8fdcc42f27d8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.097474 Aug 02 09:08:14.164810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 142/287] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:14 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:14.393868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c6852f9b-8089-4e87-b7ee-22efaa6793b7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:14.394543 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c6852f9b-8089-4e87-b7ee-22efaa6793b7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:14.401100 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c6852f9b-8089-4e87-b7ee-22efaa6793b7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:14.401547 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c6852f9b-8089-4e87-b7ee-22efaa6793b7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:14.402903 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c6852f9b-8089-4e87-b7ee-22efaa6793b7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:14.403344 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c6852f9b-8089-4e87-b7ee-22efaa6793b7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:14.557000 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c6852f9b-8089-4e87-b7ee-22efaa6793b7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:14.565130 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c6852f9b-8089-4e87-b7ee-22efaa6793b7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.175076 Aug 02 09:08:14.565732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 146/288] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:14 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:14.646702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5dc00a8a-0259-4ee2-8c8b-76fdc77bc6e5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:14.647467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5dc00a8a-0259-4ee2-8c8b-76fdc77bc6e5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:14.654885 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dc00a8a-0259-4ee2-8c8b-76fdc77bc6e5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:14.655452 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dc00a8a-0259-4ee2-8c8b-76fdc77bc6e5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:14.656400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dc00a8a-0259-4ee2-8c8b-76fdc77bc6e5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:14.656917 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dc00a8a-0259-4ee2-8c8b-76fdc77bc6e5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:14.839031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5dc00a8a-0259-4ee2-8c8b-76fdc77bc6e5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:14.847119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5dc00a8a-0259-4ee2-8c8b-76fdc77bc6e5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.210734 Aug 02 09:08:14.848044 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 143/289] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:14 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:15.187267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dfcc3377-4520-401e-9a70-8a37927e04a5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:15.188380 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-dfcc3377-4520-401e-9a70-8a37927e04a5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:15.195847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfcc3377-4520-401e-9a70-8a37927e04a5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:15.196299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfcc3377-4520-401e-9a70-8a37927e04a5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:15.197066 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfcc3377-4520-401e-9a70-8a37927e04a5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:15.197502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfcc3377-4520-401e-9a70-8a37927e04a5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:15.261836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dfcc3377-4520-401e-9a70-8a37927e04a5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:15.270144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dfcc3377-4520-401e-9a70-8a37927e04a5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.088423 Aug 02 09:08:15.271044 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 147/290] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:15 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:15.587478 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-315a3296-577b-4d9f-be6f-6bc6f1d0ff4e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:15.588113 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-315a3296-577b-4d9f-be6f-6bc6f1d0ff4e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:15.595046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-315a3296-577b-4d9f-be6f-6bc6f1d0ff4e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:15.595504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-315a3296-577b-4d9f-be6f-6bc6f1d0ff4e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:15.596292 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-315a3296-577b-4d9f-be6f-6bc6f1d0ff4e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:15.596727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-315a3296-577b-4d9f-be6f-6bc6f1d0ff4e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:15.737632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-315a3296-577b-4d9f-be6f-6bc6f1d0ff4e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:15.745570 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-315a3296-577b-4d9f-be6f-6bc6f1d0ff4e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.162380 Aug 02 09:08:15.749292 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 144/291] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:15 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:15.870932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0d8c12ec-6996-4eeb-bc44-19af95d2c736 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:15.871969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0d8c12ec-6996-4eeb-bc44-19af95d2c736 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:15.893186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d8c12ec-6996-4eeb-bc44-19af95d2c736 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:15.893796 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d8c12ec-6996-4eeb-bc44-19af95d2c736 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:15.894628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d8c12ec-6996-4eeb-bc44-19af95d2c736 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:15.895246 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d8c12ec-6996-4eeb-bc44-19af95d2c736 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:16.061013 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0d8c12ec-6996-4eeb-bc44-19af95d2c736 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:16.071248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0d8c12ec-6996-4eeb-bc44-19af95d2c736 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.204751 Aug 02 09:08:16.071992 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 148/292] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:15 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:16.292120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-06f55f5f-0ee8-44dc-8dd3-626ef53dac0e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:16.292744 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-06f55f5f-0ee8-44dc-8dd3-626ef53dac0e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:16.305599 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-06f55f5f-0ee8-44dc-8dd3-626ef53dac0e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:16.305794 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-06f55f5f-0ee8-44dc-8dd3-626ef53dac0e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:16.308819 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-06f55f5f-0ee8-44dc-8dd3-626ef53dac0e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:16.309542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-06f55f5f-0ee8-44dc-8dd3-626ef53dac0e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:16.440576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-06f55f5f-0ee8-44dc-8dd3-626ef53dac0e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:16.448482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-06f55f5f-0ee8-44dc-8dd3-626ef53dac0e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1270 microversion: 2.1 time: 0.160427 Aug 02 09:08:16.449320 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 145/293] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:16 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:16.769418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9e8bfaed-1e8c-4c52-954b-64850de03af0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:16.770076 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9e8bfaed-1e8c-4c52-954b-64850de03af0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:16.777127 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e8bfaed-1e8c-4c52-954b-64850de03af0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:16.777577 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e8bfaed-1e8c-4c52-954b-64850de03af0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:16.778400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e8bfaed-1e8c-4c52-954b-64850de03af0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:16.778836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e8bfaed-1e8c-4c52-954b-64850de03af0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:16.942843 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9e8bfaed-1e8c-4c52-954b-64850de03af0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:16.950812 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9e8bfaed-1e8c-4c52-954b-64850de03af0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.185645 Aug 02 09:08:16.951393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 149/294] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:16 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:17.093670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d4a4a4c3-8d48-40a9-83ca-a2f44c72ec87 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:17.094396 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d4a4a4c3-8d48-40a9-83ca-a2f44c72ec87 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:17.101156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4a4a4c3-8d48-40a9-83ca-a2f44c72ec87 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:17.102754 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4a4a4c3-8d48-40a9-83ca-a2f44c72ec87 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:17.103928 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4a4a4c3-8d48-40a9-83ca-a2f44c72ec87 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:17.104380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4a4a4c3-8d48-40a9-83ca-a2f44c72ec87 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:17.246108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d4a4a4c3-8d48-40a9-83ca-a2f44c72ec87 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:17.253964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d4a4a4c3-8d48-40a9-83ca-a2f44c72ec87 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.163918 Aug 02 09:08:17.254451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 146/295] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:17 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:17.470221 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2731ca19-9a2a-4575-94e1-4fab5a4f5de5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:17.471608 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2731ca19-9a2a-4575-94e1-4fab5a4f5de5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:17.478725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2731ca19-9a2a-4575-94e1-4fab5a4f5de5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:17.479188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2731ca19-9a2a-4575-94e1-4fab5a4f5de5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:17.479967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2731ca19-9a2a-4575-94e1-4fab5a4f5de5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:17.480407 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2731ca19-9a2a-4575-94e1-4fab5a4f5de5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:17.547448 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2731ca19-9a2a-4575-94e1-4fab5a4f5de5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:17.555947 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2731ca19-9a2a-4575-94e1-4fab5a4f5de5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1278 microversion: 2.1 time: 0.089400 Aug 02 09:08:17.556505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 150/296] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:17 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:17.973267 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b87caa53-c9ea-40b2-a85e-b25ac6ff6c1b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:17.973873 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b87caa53-c9ea-40b2-a85e-b25ac6ff6c1b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:17.983038 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b87caa53-c9ea-40b2-a85e-b25ac6ff6c1b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:17.983574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b87caa53-c9ea-40b2-a85e-b25ac6ff6c1b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:17.984359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b87caa53-c9ea-40b2-a85e-b25ac6ff6c1b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:17.984819 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b87caa53-c9ea-40b2-a85e-b25ac6ff6c1b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:18.118734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b87caa53-c9ea-40b2-a85e-b25ac6ff6c1b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:18.126302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b87caa53-c9ea-40b2-a85e-b25ac6ff6c1b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.157939 Aug 02 09:08:18.126862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 147/297] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:17 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:18.277032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fa7b4cad-2016-412d-8e62-5fce9a18bf53 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:18.277641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fa7b4cad-2016-412d-8e62-5fce9a18bf53 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:18.284569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa7b4cad-2016-412d-8e62-5fce9a18bf53 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:18.285017 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa7b4cad-2016-412d-8e62-5fce9a18bf53 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:18.285795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa7b4cad-2016-412d-8e62-5fce9a18bf53 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:18.286255 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa7b4cad-2016-412d-8e62-5fce9a18bf53 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:18.429421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fa7b4cad-2016-412d-8e62-5fce9a18bf53 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:18.437528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fa7b4cad-2016-412d-8e62-5fce9a18bf53 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.164982 Aug 02 09:08:18.438126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 151/298] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:18 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:18.579655 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fd674e21-9c7e-47c4-ac3c-9734e9a18d4d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:18.580533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fd674e21-9c7e-47c4-ac3c-9734e9a18d4d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:18.582509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:18.587866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd674e21-9c7e-47c4-ac3c-9734e9a18d4d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:18.588318 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd674e21-9c7e-47c4-ac3c-9734e9a18d4d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:18.589099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd674e21-9c7e-47c4-ac3c-9734e9a18d4d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:18.589527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd674e21-9c7e-47c4-ac3c-9734e9a18d4d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:18.665738 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fd674e21-9c7e-47c4-ac3c-9734e9a18d4d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:18.673259 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fd674e21-9c7e-47c4-ac3c-9734e9a18d4d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1278 microversion: 2.1 time: 0.097617 Aug 02 09:08:18.673832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 148/299] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:18 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:19.148080 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0ac14cdf-bf32-41a6-9f66-21bf99aec6ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:19.149389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0ac14cdf-bf32-41a6-9f66-21bf99aec6ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:19.151429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:19.156391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0ac14cdf-bf32-41a6-9f66-21bf99aec6ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:19.157046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0ac14cdf-bf32-41a6-9f66-21bf99aec6ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:19.158020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0ac14cdf-bf32-41a6-9f66-21bf99aec6ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:19.158460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0ac14cdf-bf32-41a6-9f66-21bf99aec6ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:19.297702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0ac14cdf-bf32-41a6-9f66-21bf99aec6ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:19.305548 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0ac14cdf-bf32-41a6-9f66-21bf99aec6ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.161328 Aug 02 09:08:19.306157 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 152/300] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:19 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:19.459359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-988ccf32-c7a9-44b2-98bb-f50aa82d9b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:19.460165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-988ccf32-c7a9-44b2-98bb-f50aa82d9b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:19.466779 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-988ccf32-c7a9-44b2-98bb-f50aa82d9b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:19.467624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-988ccf32-c7a9-44b2-98bb-f50aa82d9b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:19.477080 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-988ccf32-c7a9-44b2-98bb-f50aa82d9b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:19.477080 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-988ccf32-c7a9-44b2-98bb-f50aa82d9b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:19.699141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dc646493-731a-4d1f-a1c1-428dc8df69f1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:19.700460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-dc646493-731a-4d1f-a1c1-428dc8df69f1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:19.712812 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dc646493-731a-4d1f-a1c1-428dc8df69f1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:19.713655 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dc646493-731a-4d1f-a1c1-428dc8df69f1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:19.715158 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dc646493-731a-4d1f-a1c1-428dc8df69f1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:19.716091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dc646493-731a-4d1f-a1c1-428dc8df69f1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:19.764168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-988ccf32-c7a9-44b2-98bb-f50aa82d9b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:19.771947 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-988ccf32-c7a9-44b2-98bb-f50aa82d9b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.317313 Aug 02 09:08:19.772527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 149/301] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:19 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:19.786564 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dc646493-731a-4d1f-a1c1-428dc8df69f1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:19.794055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dc646493-731a-4d1f-a1c1-428dc8df69f1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1278 microversion: 2.1 time: 0.104029 Aug 02 09:08:19.794615 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 153/302] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:19 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:20.327023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-aba1034e-1dc8-4e8f-aaea-850ca9f677f2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:20.327636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-aba1034e-1dc8-4e8f-aaea-850ca9f677f2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:20.334451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aba1034e-1dc8-4e8f-aaea-850ca9f677f2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:20.334887 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aba1034e-1dc8-4e8f-aaea-850ca9f677f2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:20.335647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aba1034e-1dc8-4e8f-aaea-850ca9f677f2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:20.336112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aba1034e-1dc8-4e8f-aaea-850ca9f677f2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:20.340314 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:20.477429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-aba1034e-1dc8-4e8f-aaea-850ca9f677f2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:20.484991 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-aba1034e-1dc8-4e8f-aaea-850ca9f677f2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.161876 Aug 02 09:08:20.485568 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 150/303] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:20 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:20.794164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-bf45e10e-1543-4ce9-b48b-6121e5cbf772 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:20.794763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-bf45e10e-1543-4ce9-b48b-6121e5cbf772 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:20.801114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bf45e10e-1543-4ce9-b48b-6121e5cbf772 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:20.801565 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bf45e10e-1543-4ce9-b48b-6121e5cbf772 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:20.802381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bf45e10e-1543-4ce9-b48b-6121e5cbf772 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:20.802819 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bf45e10e-1543-4ce9-b48b-6121e5cbf772 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:20.816768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ea7fa4e6-5528-4ac8-a8ff-dbbf3ed883ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:20.817379 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ea7fa4e6-5528-4ac8-a8ff-dbbf3ed883ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:20.823590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea7fa4e6-5528-4ac8-a8ff-dbbf3ed883ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:20.824040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea7fa4e6-5528-4ac8-a8ff-dbbf3ed883ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:20.824813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea7fa4e6-5528-4ac8-a8ff-dbbf3ed883ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:20.825252 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea7fa4e6-5528-4ac8-a8ff-dbbf3ed883ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:20.893804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ea7fa4e6-5528-4ac8-a8ff-dbbf3ed883ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:20.902140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ea7fa4e6-5528-4ac8-a8ff-dbbf3ed883ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1278 microversion: 2.1 time: 0.089087 Aug 02 09:08:20.902713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 151/304] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:20 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:20.944534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bf45e10e-1543-4ce9-b48b-6121e5cbf772 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:20.952559 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-bf45e10e-1543-4ce9-b48b-6121e5cbf772 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.162859 Aug 02 09:08:20.953108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 154/305] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:20 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:21.506963 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1cf62b79-a4d1-45a9-96f7-58ededa92d87 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:21.507602 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1cf62b79-a4d1-45a9-96f7-58ededa92d87 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:21.515419 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1cf62b79-a4d1-45a9-96f7-58ededa92d87 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:21.515871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1cf62b79-a4d1-45a9-96f7-58ededa92d87 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:21.516647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1cf62b79-a4d1-45a9-96f7-58ededa92d87 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:21.517239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1cf62b79-a4d1-45a9-96f7-58ededa92d87 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:21.657042 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1cf62b79-a4d1-45a9-96f7-58ededa92d87 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:21.666834 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1cf62b79-a4d1-45a9-96f7-58ededa92d87 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.163699 Aug 02 09:08:21.667429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 152/306] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:21 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:21.926003 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d8c51426-eb70-4d45-94ee-7b35b24cb5c7 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:21.926869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d8c51426-eb70-4d45-94ee-7b35b24cb5c7 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:21.934233 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d8c51426-eb70-4d45-94ee-7b35b24cb5c7 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:21.934688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d8c51426-eb70-4d45-94ee-7b35b24cb5c7 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:21.935588 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d8c51426-eb70-4d45-94ee-7b35b24cb5c7 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:21.936149 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d8c51426-eb70-4d45-94ee-7b35b24cb5c7 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:21.980691 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-73826bc2-feaf-4d90-9c6d-5af347eb1888 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:21.981309 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-73826bc2-feaf-4d90-9c6d-5af347eb1888 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:21.987856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-73826bc2-feaf-4d90-9c6d-5af347eb1888 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:21.988302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-73826bc2-feaf-4d90-9c6d-5af347eb1888 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:21.989074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-73826bc2-feaf-4d90-9c6d-5af347eb1888 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:21.989815 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-73826bc2-feaf-4d90-9c6d-5af347eb1888 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:22.006446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d8c51426-eb70-4d45-94ee-7b35b24cb5c7 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:22.018780 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d8c51426-eb70-4d45-94ee-7b35b24cb5c7 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1278 microversion: 2.1 time: 0.097868 Aug 02 09:08:22.019673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 155/307] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:21 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:22.132011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-73826bc2-feaf-4d90-9c6d-5af347eb1888 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:22.141256 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-73826bc2-feaf-4d90-9c6d-5af347eb1888 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.170226 Aug 02 09:08:22.146301 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 153/308] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:21 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:22.694694 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1141a457-085e-4027-83be-cba80431c894 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:22.695838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1141a457-085e-4027-83be-cba80431c894 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:22.707713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1141a457-085e-4027-83be-cba80431c894 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:22.708165 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1141a457-085e-4027-83be-cba80431c894 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:22.708939 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1141a457-085e-4027-83be-cba80431c894 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:22.709489 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1141a457-085e-4027-83be-cba80431c894 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:22.941661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1141a457-085e-4027-83be-cba80431c894 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:22.950132 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1141a457-085e-4027-83be-cba80431c894 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.265457 Aug 02 09:08:22.951026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 156/309] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:22 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:23.040789 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-dc98fb7f-0dd1-40c6-a422-acc53a7e5dbd tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:23.041387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-dc98fb7f-0dd1-40c6-a422-acc53a7e5dbd tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:23.048113 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dc98fb7f-0dd1-40c6-a422-acc53a7e5dbd tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:23.048555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dc98fb7f-0dd1-40c6-a422-acc53a7e5dbd tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:23.049319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dc98fb7f-0dd1-40c6-a422-acc53a7e5dbd tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:23.049773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dc98fb7f-0dd1-40c6-a422-acc53a7e5dbd tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:23.126708 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-dc98fb7f-0dd1-40c6-a422-acc53a7e5dbd tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:23.140949 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-dc98fb7f-0dd1-40c6-a422-acc53a7e5dbd tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1278 microversion: 2.1 time: 0.104024 Aug 02 09:08:23.141551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 154/310] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:23 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:23.178391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4650dcb4-7e39-4dc8-9db7-5ce99401cb50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:23.178391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4650dcb4-7e39-4dc8-9db7-5ce99401cb50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:23.181323 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4650dcb4-7e39-4dc8-9db7-5ce99401cb50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:23.181943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4650dcb4-7e39-4dc8-9db7-5ce99401cb50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:23.182842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4650dcb4-7e39-4dc8-9db7-5ce99401cb50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:23.183343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4650dcb4-7e39-4dc8-9db7-5ce99401cb50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:23.329411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4650dcb4-7e39-4dc8-9db7-5ce99401cb50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:23.338192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4650dcb4-7e39-4dc8-9db7-5ce99401cb50 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.169305 Aug 02 09:08:23.338690 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 157/311] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:23 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:23.971805 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-edc90d64-c6ac-4fad-8e88-ad8b70c46b01 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:23.972511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-edc90d64-c6ac-4fad-8e88-ad8b70c46b01 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:23.979673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-edc90d64-c6ac-4fad-8e88-ad8b70c46b01 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:23.980121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-edc90d64-c6ac-4fad-8e88-ad8b70c46b01 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:23.980913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-edc90d64-c6ac-4fad-8e88-ad8b70c46b01 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:23.981338 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-edc90d64-c6ac-4fad-8e88-ad8b70c46b01 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:24.122984 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-edc90d64-c6ac-4fad-8e88-ad8b70c46b01 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:24.134328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-edc90d64-c6ac-4fad-8e88-ad8b70c46b01 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.162496 Aug 02 09:08:24.134328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 155/312] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:23 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:24.164485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d5c80ef5-f623-4417-ad5c-8f9d1366db1f tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:24.165118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d5c80ef5-f623-4417-ad5c-8f9d1366db1f tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:24.171425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5c80ef5-f623-4417-ad5c-8f9d1366db1f tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:24.174763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5c80ef5-f623-4417-ad5c-8f9d1366db1f tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:24.174763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5c80ef5-f623-4417-ad5c-8f9d1366db1f tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:24.174763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5c80ef5-f623-4417-ad5c-8f9d1366db1f tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:24.294304 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d5c80ef5-f623-4417-ad5c-8f9d1366db1f tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:24.297767 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:24.302141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d5c80ef5-f623-4417-ad5c-8f9d1366db1f tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1278 microversion: 2.1 time: 0.142405 Aug 02 09:08:24.302717 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 158/313] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:24 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1278 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:24.364540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f415344a-89a5-4c3c-8def-27f29c389e44 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:24.365350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f415344a-89a5-4c3c-8def-27f29c389e44 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:24.371900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f415344a-89a5-4c3c-8def-27f29c389e44 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:24.372348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f415344a-89a5-4c3c-8def-27f29c389e44 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:24.373160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f415344a-89a5-4c3c-8def-27f29c389e44 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:24.373753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f415344a-89a5-4c3c-8def-27f29c389e44 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:24.537519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f415344a-89a5-4c3c-8def-27f29c389e44 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:24.557087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f415344a-89a5-4c3c-8def-27f29c389e44 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.196285 Aug 02 09:08:24.557688 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 156/314] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:24 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:25.152338 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e7e8f5cf-eb09-4932-b06d-e4ded11e99ef tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:25.152975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e7e8f5cf-eb09-4932-b06d-e4ded11e99ef tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:25.160942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e7e8f5cf-eb09-4932-b06d-e4ded11e99ef tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:25.161599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e7e8f5cf-eb09-4932-b06d-e4ded11e99ef tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:25.163473 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e7e8f5cf-eb09-4932-b06d-e4ded11e99ef tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:25.171295 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e7e8f5cf-eb09-4932-b06d-e4ded11e99ef tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:25.323661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ee6f3d86-db9c-48bf-b7c1-21493f60cc8e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:25.326059 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ee6f3d86-db9c-48bf-b7c1-21493f60cc8e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:25.335441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee6f3d86-db9c-48bf-b7c1-21493f60cc8e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:25.336508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee6f3d86-db9c-48bf-b7c1-21493f60cc8e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:25.337362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee6f3d86-db9c-48bf-b7c1-21493f60cc8e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:25.338053 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee6f3d86-db9c-48bf-b7c1-21493f60cc8e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:25.404127 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e7e8f5cf-eb09-4932-b06d-e4ded11e99ef tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:25.412105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e7e8f5cf-eb09-4932-b06d-e4ded11e99ef tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.264178 Aug 02 09:08:25.412702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 159/315] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:25 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:25.460380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ee6f3d86-db9c-48bf-b7c1-21493f60cc8e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:25.470838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ee6f3d86-db9c-48bf-b7c1-21493f60cc8e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1288 microversion: 2.1 time: 0.152218 Aug 02 09:08:25.472529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 157/316] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:25 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1288 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:25.580410 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-18bc69c5-5ff4-412f-9b99-2000ce791aad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:25.581629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-18bc69c5-5ff4-412f-9b99-2000ce791aad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:25.594901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18bc69c5-5ff4-412f-9b99-2000ce791aad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:25.596875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18bc69c5-5ff4-412f-9b99-2000ce791aad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:25.597772 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18bc69c5-5ff4-412f-9b99-2000ce791aad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:25.598278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18bc69c5-5ff4-412f-9b99-2000ce791aad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:25.838641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-18bc69c5-5ff4-412f-9b99-2000ce791aad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:25.846531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-18bc69c5-5ff4-412f-9b99-2000ce791aad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1522 microversion: 2.1 time: 0.270578 Aug 02 09:08:25.847117 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 160/317] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:25 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:26.434621 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-774f798f-cefe-4210-b5b5-58c5a8e6833a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:26.435247 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-774f798f-cefe-4210-b5b5-58c5a8e6833a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:26.442141 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-774f798f-cefe-4210-b5b5-58c5a8e6833a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:26.442592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-774f798f-cefe-4210-b5b5-58c5a8e6833a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:26.443442 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-774f798f-cefe-4210-b5b5-58c5a8e6833a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:26.443885 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-774f798f-cefe-4210-b5b5-58c5a8e6833a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:26.493327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-89515add-4bfb-426e-8893-b7cbee18eca8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:26.494094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-89515add-4bfb-426e-8893-b7cbee18eca8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:26.501002 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-89515add-4bfb-426e-8893-b7cbee18eca8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:26.501503 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-89515add-4bfb-426e-8893-b7cbee18eca8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:26.502398 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-89515add-4bfb-426e-8893-b7cbee18eca8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:26.502836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-89515add-4bfb-426e-8893-b7cbee18eca8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:26.653499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-89515add-4bfb-426e-8893-b7cbee18eca8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:26.661661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-89515add-4bfb-426e-8893-b7cbee18eca8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.172701 Aug 02 09:08:26.662409 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 161/318] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:26 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:26.839541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-774f798f-cefe-4210-b5b5-58c5a8e6833a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:26.846955 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-774f798f-cefe-4210-b5b5-58c5a8e6833a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.416465 Aug 02 09:08:26.847514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 158/319] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:26 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:26.869060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5999dc65-3576-4c01-9a5d-07328a18b444 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:26.870765 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5999dc65-3576-4c01-9a5d-07328a18b444 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:26.875802 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5999dc65-3576-4c01-9a5d-07328a18b444 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:26.876250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5999dc65-3576-4c01-9a5d-07328a18b444 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:26.877007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5999dc65-3576-4c01-9a5d-07328a18b444 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:26.877438 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5999dc65-3576-4c01-9a5d-07328a18b444 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:27.019847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5999dc65-3576-4c01-9a5d-07328a18b444 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:27.027530 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5999dc65-3576-4c01-9a5d-07328a18b444 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1502 microversion: 2.1 time: 0.162845 Aug 02 09:08:27.028092 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 162/320] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:26 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:27.048180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-16ba6c78-a0fb-451b-b314-b1bbc660e65b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:27.048940 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-16ba6c78-a0fb-451b-b314-b1bbc660e65b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:27.056450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-16ba6c78-a0fb-451b-b314-b1bbc660e65b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:27.056977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-16ba6c78-a0fb-451b-b314-b1bbc660e65b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:27.057768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-16ba6c78-a0fb-451b-b314-b1bbc660e65b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:27.066548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-16ba6c78-a0fb-451b-b314-b1bbc660e65b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:27.194818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-16ba6c78-a0fb-451b-b314-b1bbc660e65b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:27.202452 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-16ba6c78-a0fb-451b-b314-b1bbc660e65b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1514 microversion: 2.1 time: 0.158037 Aug 02 09:08:27.203030 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 159/321] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:27 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:27.689414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c5dd94ab-d255-4aa6-8f05-7ccb66013cbc tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:27.690724 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c5dd94ab-d255-4aa6-8f05-7ccb66013cbc tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:27.697189 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c5dd94ab-d255-4aa6-8f05-7ccb66013cbc tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:27.697645 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c5dd94ab-d255-4aa6-8f05-7ccb66013cbc tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:27.698439 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c5dd94ab-d255-4aa6-8f05-7ccb66013cbc tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:27.698875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c5dd94ab-d255-4aa6-8f05-7ccb66013cbc tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:27.844984 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c5dd94ab-d255-4aa6-8f05-7ccb66013cbc tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:27.852894 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c5dd94ab-d255-4aa6-8f05-7ccb66013cbc tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.171164 Aug 02 09:08:27.853464 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 163/322] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:27 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:27.869482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5813bf6b-0853-4889-8a8f-761b161c85b4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:27.870416 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5813bf6b-0853-4889-8a8f-761b161c85b4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:27.884886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5813bf6b-0853-4889-8a8f-761b161c85b4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:27.884886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5813bf6b-0853-4889-8a8f-761b161c85b4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:27.884886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5813bf6b-0853-4889-8a8f-761b161c85b4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:27.884886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5813bf6b-0853-4889-8a8f-761b161c85b4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:28.014708 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5813bf6b-0853-4889-8a8f-761b161c85b4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:28.022859 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5813bf6b-0853-4889-8a8f-761b161c85b4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.158111 Aug 02 09:08:28.024066 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 160/323] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:27 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:28.882855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-74ff75f5-de00-405d-92b2-c43676bab7af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:28.882855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-74ff75f5-de00-405d-92b2-c43676bab7af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:28.882855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74ff75f5-de00-405d-92b2-c43676bab7af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:28.882855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74ff75f5-de00-405d-92b2-c43676bab7af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:28.883631 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74ff75f5-de00-405d-92b2-c43676bab7af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:28.883844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74ff75f5-de00-405d-92b2-c43676bab7af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:29.016962 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-74ff75f5-de00-405d-92b2-c43676bab7af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:29.025442 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-74ff75f5-de00-405d-92b2-c43676bab7af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.154871 Aug 02 09:08:29.026094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 164/324] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:28 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:29.045110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e2754739-ef63-4cdc-bb8f-ee750356efd7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:29.045741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e2754739-ef63-4cdc-bb8f-ee750356efd7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:29.052319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e2754739-ef63-4cdc-bb8f-ee750356efd7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:29.059502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e2754739-ef63-4cdc-bb8f-ee750356efd7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:29.059502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e2754739-ef63-4cdc-bb8f-ee750356efd7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:29.059502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e2754739-ef63-4cdc-bb8f-ee750356efd7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:29.192045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e2754739-ef63-4cdc-bb8f-ee750356efd7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:29.199901 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e2754739-ef63-4cdc-bb8f-ee750356efd7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.158656 Aug 02 09:08:29.200479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 161/325] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:29 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:30.047523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e861e466-507b-4e1e-b268-d8f2b92e2143 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:30.048107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e861e466-507b-4e1e-b268-d8f2b92e2143 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:30.054109 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e861e466-507b-4e1e-b268-d8f2b92e2143 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:30.055136 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e861e466-507b-4e1e-b268-d8f2b92e2143 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:30.055899 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e861e466-507b-4e1e-b268-d8f2b92e2143 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:30.056327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e861e466-507b-4e1e-b268-d8f2b92e2143 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:30.212359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e861e466-507b-4e1e-b268-d8f2b92e2143 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:30.221339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a44fd352-31c5-4a4e-b112-cdccf69a5b86 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:30.221813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e861e466-507b-4e1e-b268-d8f2b92e2143 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.177904 Aug 02 09:08:30.222036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a44fd352-31c5-4a4e-b112-cdccf69a5b86 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:30.222257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 165/326] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:30 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:30.228683 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a44fd352-31c5-4a4e-b112-cdccf69a5b86 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:30.229426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a44fd352-31c5-4a4e-b112-cdccf69a5b86 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:30.230367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a44fd352-31c5-4a4e-b112-cdccf69a5b86 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:30.230927 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a44fd352-31c5-4a4e-b112-cdccf69a5b86 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:30.372338 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a44fd352-31c5-4a4e-b112-cdccf69a5b86 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:30.405597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a44fd352-31c5-4a4e-b112-cdccf69a5b86 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.181794 Aug 02 09:08:30.413259 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 162/327] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:30 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:31.242969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-00d1ef0c-ef92-4459-943b-dfe01acd2bf1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:31.243834 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-00d1ef0c-ef92-4459-943b-dfe01acd2bf1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:31.250087 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-00d1ef0c-ef92-4459-943b-dfe01acd2bf1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:31.250680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-00d1ef0c-ef92-4459-943b-dfe01acd2bf1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:31.251820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-00d1ef0c-ef92-4459-943b-dfe01acd2bf1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:31.252599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-00d1ef0c-ef92-4459-943b-dfe01acd2bf1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:31.433976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-525d1aff-389d-42bf-af00-d31c6c6a423c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:31.434654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-525d1aff-389d-42bf-af00-d31c6c6a423c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:31.441069 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-525d1aff-389d-42bf-af00-d31c6c6a423c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:31.441548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-525d1aff-389d-42bf-af00-d31c6c6a423c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:31.442337 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-525d1aff-389d-42bf-af00-d31c6c6a423c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:31.442942 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-525d1aff-389d-42bf-af00-d31c6c6a423c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:31.463893 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-00d1ef0c-ef92-4459-943b-dfe01acd2bf1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:31.466101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-00d1ef0c-ef92-4459-943b-dfe01acd2bf1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.227874 Aug 02 09:08:31.467005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 166/328] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:31 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:31.575121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-525d1aff-389d-42bf-af00-d31c6c6a423c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:31.582753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-525d1aff-389d-42bf-af00-d31c6c6a423c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.153896 Aug 02 09:08:31.583308 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 163/329] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:31 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:31.670946 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-60fd698e-527e-42e4-9d9e-3cc4bbb7b5c9 req-26e5e042-39ba-464c-93d6-36460fda44b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df72120-5785-40dc-94eb-4fb66b4a8fc0", "tag": "4b8a4403-3f1c-4e67-ba1b-5cb012dccd2f"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:08:31.681280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-60fd698e-527e-42e4-9d9e-3cc4bbb7b5c9 req-26e5e042-39ba-464c-93d6-36460fda44b2 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:31.681719 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-60fd698e-527e-42e4-9d9e-3cc4bbb7b5c9 req-26e5e042-39ba-464c-93d6-36460fda44b2 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:31.693500 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-60fd698e-527e-42e4-9d9e-3cc4bbb7b5c9 req-26e5e042-39ba-464c-93d6-36460fda44b2 service nova] Creating event network-changed:4b8a4403-3f1c-4e67-ba1b-5cb012dccd2f for instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 on hv-cinder-84713 Aug 02 09:08:31.699111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-60fd698e-527e-42e4-9d9e-3cc4bbb7b5c9 req-26e5e042-39ba-464c-93d6-36460fda44b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032254 Aug 02 09:08:31.699709 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 167/330] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:32.488819 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c17ac39e-12f8-4a9c-951a-97e37a57335e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:32.489583 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c17ac39e-12f8-4a9c-951a-97e37a57335e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:32.497029 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c17ac39e-12f8-4a9c-951a-97e37a57335e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:32.497543 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c17ac39e-12f8-4a9c-951a-97e37a57335e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:32.498641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c17ac39e-12f8-4a9c-951a-97e37a57335e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:32.499110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c17ac39e-12f8-4a9c-951a-97e37a57335e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:32.605550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-34a2f9e6-a795-423d-a9c5-c940dd9f0a95 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:32.606279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-34a2f9e6-a795-423d-a9c5-c940dd9f0a95 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:32.613634 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-34a2f9e6-a795-423d-a9c5-c940dd9f0a95 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:32.614675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-34a2f9e6-a795-423d-a9c5-c940dd9f0a95 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:32.615824 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-34a2f9e6-a795-423d-a9c5-c940dd9f0a95 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:32.616490 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-34a2f9e6-a795-423d-a9c5-c940dd9f0a95 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:32.657439 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c17ac39e-12f8-4a9c-951a-97e37a57335e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:32.664892 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c17ac39e-12f8-4a9c-951a-97e37a57335e tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.180335 Aug 02 09:08:32.665452 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 164/331] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:32 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:32.670507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-bcbad93e-10c1-4999-b686-fcc989c61651 req-fbc2fb85-e582-48f8-a7dc-3313ab230781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9b683c-91dd-41ab-a9ee-45c9af6dc89b", "name": "network-vif-plugged", "status": "completed", "tag": "c42abcac-01a1-4142-811d-f1eb28ab8e79"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:08:32.680544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-bcbad93e-10c1-4999-b686-fcc989c61651 req-fbc2fb85-e582-48f8-a7dc-3313ab230781 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:32.680982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-bcbad93e-10c1-4999-b686-fcc989c61651 req-fbc2fb85-e582-48f8-a7dc-3313ab230781 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:32.693195 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-bcbad93e-10c1-4999-b686-fcc989c61651 req-fbc2fb85-e582-48f8-a7dc-3313ab230781 service nova] Creating event network-vif-plugged:c42abcac-01a1-4142-811d-f1eb28ab8e79 for instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b on hv-cinder-84713 Aug 02 09:08:32.699258 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-bcbad93e-10c1-4999-b686-fcc989c61651 req-fbc2fb85-e582-48f8-a7dc-3313ab230781 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032454 Aug 02 09:08:32.699906 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 165/332] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:32.803857 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-34a2f9e6-a795-423d-a9c5-c940dd9f0a95 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:32.810202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-34a2f9e6-a795-423d-a9c5-c940dd9f0a95 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.209575 Aug 02 09:08:32.811248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 168/333] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:32 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:32.896234 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f2d202ea-6a3b-4f8a-b647-5c9beeb16f29 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:08:32.898521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f2d202ea-6a3b-4f8a-b647-5c9beeb16f29 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:32.904869 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f2d202ea-6a3b-4f8a-b647-5c9beeb16f29 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:32.905309 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f2d202ea-6a3b-4f8a-b647-5c9beeb16f29 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:32.906180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f2d202ea-6a3b-4f8a-b647-5c9beeb16f29 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:32.906611 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f2d202ea-6a3b-4f8a-b647-5c9beeb16f29 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:32.930791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-f2d202ea-6a3b-4f8a-b647-5c9beeb16f29 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lazy-loading 'flavor' on Instance uuid 03b73e88-9298-4f0b-b36b-069907a1a076 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:08:32.996575 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:33.515716 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f2d202ea-6a3b-4f8a-b647-5c9beeb16f29 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076/action" status: 200 len: 32 microversion: 2.1 time: 0.623653 Aug 02 09:08:33.516392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 166/334] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:08:32 2022] POST /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076/action => generated 32 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:08:33.527108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-342fc003-8d71-4421-9a9b-5d55a087184a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:33.527781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-342fc003-8d71-4421-9a9b-5d55a087184a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:33.534684 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-342fc003-8d71-4421-9a9b-5d55a087184a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:33.535112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-342fc003-8d71-4421-9a9b-5d55a087184a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:33.535905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-342fc003-8d71-4421-9a9b-5d55a087184a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:33.536424 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-342fc003-8d71-4421-9a9b-5d55a087184a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:33.670154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-342fc003-8d71-4421-9a9b-5d55a087184a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:33.677573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-342fc003-8d71-4421-9a9b-5d55a087184a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.155449 Aug 02 09:08:33.678175 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 169/335] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:33 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:33.685685 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fe7e2647-2405-4c67-b86f-b946e2bbfbaa tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:33.686393 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fe7e2647-2405-4c67-b86f-b946e2bbfbaa tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:33.693426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fe7e2647-2405-4c67-b86f-b946e2bbfbaa tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:33.693868 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fe7e2647-2405-4c67-b86f-b946e2bbfbaa tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:33.694646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fe7e2647-2405-4c67-b86f-b946e2bbfbaa tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:33.695622 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fe7e2647-2405-4c67-b86f-b946e2bbfbaa tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:33.829716 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fe7e2647-2405-4c67-b86f-b946e2bbfbaa tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:33.832328 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a04af696-1966-448d-8903-9414a6454a39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:33.832964 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a04af696-1966-448d-8903-9414a6454a39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:33.838183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fe7e2647-2405-4c67-b86f-b946e2bbfbaa tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.156526 Aug 02 09:08:33.838753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 167/336] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:33 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:33.840206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a04af696-1966-448d-8903-9414a6454a39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:33.840655 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a04af696-1966-448d-8903-9414a6454a39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:33.841477 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a04af696-1966-448d-8903-9414a6454a39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:33.841982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a04af696-1966-448d-8903-9414a6454a39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:33.992707 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a04af696-1966-448d-8903-9414a6454a39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:34.000557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a04af696-1966-448d-8903-9414a6454a39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.172478 Aug 02 09:08:34.001120 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 170/337] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:33 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:34.699600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1349f658-a725-487a-8772-ba6cc81baa95 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:34.700802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1349f658-a725-487a-8772-ba6cc81baa95 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:34.711693 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1349f658-a725-487a-8772-ba6cc81baa95 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:34.711693 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1349f658-a725-487a-8772-ba6cc81baa95 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:34.711693 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1349f658-a725-487a-8772-ba6cc81baa95 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:34.711693 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1349f658-a725-487a-8772-ba6cc81baa95 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:34.847451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1349f658-a725-487a-8772-ba6cc81baa95 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:34.856352 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1349f658-a725-487a-8772-ba6cc81baa95 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.160815 Aug 02 09:08:34.863063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 168/338] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:34 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:34.863217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4c3dad36-b7da-4c4e-9ad8-410e4bc37305 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:34.863217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4c3dad36-b7da-4c4e-9ad8-410e4bc37305 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:34.867579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c3dad36-b7da-4c4e-9ad8-410e4bc37305 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:34.874301 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c3dad36-b7da-4c4e-9ad8-410e4bc37305 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:34.874301 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c3dad36-b7da-4c4e-9ad8-410e4bc37305 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:34.874301 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c3dad36-b7da-4c4e-9ad8-410e4bc37305 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:35.002156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4c3dad36-b7da-4c4e-9ad8-410e4bc37305 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:35.009645 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4c3dad36-b7da-4c4e-9ad8-410e4bc37305 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.154017 Aug 02 09:08:35.010243 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 171/339] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:34 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:35.022954 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1f54c716-7b4d-440e-8d0b-181b04522b0d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:35.023558 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1f54c716-7b4d-440e-8d0b-181b04522b0d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:35.030355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1f54c716-7b4d-440e-8d0b-181b04522b0d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:35.030905 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1f54c716-7b4d-440e-8d0b-181b04522b0d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:35.031667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1f54c716-7b4d-440e-8d0b-181b04522b0d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:35.032101 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1f54c716-7b4d-440e-8d0b-181b04522b0d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:35.171285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1f54c716-7b4d-440e-8d0b-181b04522b0d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:35.178726 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1f54c716-7b4d-440e-8d0b-181b04522b0d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.159602 Aug 02 09:08:35.179282 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 169/340] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:35 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:35.877926 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-64c02b37-0ac6-47ab-bb09-41890e93301f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:35.878537 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-64c02b37-0ac6-47ab-bb09-41890e93301f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:35.886154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-64c02b37-0ac6-47ab-bb09-41890e93301f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:35.886608 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-64c02b37-0ac6-47ab-bb09-41890e93301f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:35.887431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-64c02b37-0ac6-47ab-bb09-41890e93301f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:35.887820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-64c02b37-0ac6-47ab-bb09-41890e93301f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:36.023224 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-64c02b37-0ac6-47ab-bb09-41890e93301f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:36.030969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2fd60bc5-27e7-4a0f-8c4c-a63e8d7ba9e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:36.031467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-64c02b37-0ac6-47ab-bb09-41890e93301f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.157413 Aug 02 09:08:36.031601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2fd60bc5-27e7-4a0f-8c4c-a63e8d7ba9e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:36.039170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 172/341] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:35 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:36.039297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2fd60bc5-27e7-4a0f-8c4c-a63e8d7ba9e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:36.039297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2fd60bc5-27e7-4a0f-8c4c-a63e8d7ba9e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:36.039857 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2fd60bc5-27e7-4a0f-8c4c-a63e8d7ba9e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:36.040300 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2fd60bc5-27e7-4a0f-8c4c-a63e8d7ba9e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:36.173143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2fd60bc5-27e7-4a0f-8c4c-a63e8d7ba9e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:36.180877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2fd60bc5-27e7-4a0f-8c4c-a63e8d7ba9e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.153533 Aug 02 09:08:36.181487 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 170/342] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:36 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:36.201014 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c9f4ec97-db38-4ad6-b794-508b6baec7ed tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:36.201760 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c9f4ec97-db38-4ad6-b794-508b6baec7ed tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:36.208201 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c9f4ec97-db38-4ad6-b794-508b6baec7ed tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:36.219367 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c9f4ec97-db38-4ad6-b794-508b6baec7ed tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:36.219367 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c9f4ec97-db38-4ad6-b794-508b6baec7ed tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:36.219367 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c9f4ec97-db38-4ad6-b794-508b6baec7ed tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:36.348694 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c9f4ec97-db38-4ad6-b794-508b6baec7ed tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:36.356628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c9f4ec97-db38-4ad6-b794-508b6baec7ed tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.159552 Aug 02 09:08:36.357183 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 173/343] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:36 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:37.056232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ea52a38f-f473-40dd-bae1-3e839b2034ac tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:37.056958 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ea52a38f-f473-40dd-bae1-3e839b2034ac tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:37.064051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea52a38f-f473-40dd-bae1-3e839b2034ac tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:37.064333 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea52a38f-f473-40dd-bae1-3e839b2034ac tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:37.065189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea52a38f-f473-40dd-bae1-3e839b2034ac tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:37.065624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea52a38f-f473-40dd-bae1-3e839b2034ac tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:37.198613 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ea52a38f-f473-40dd-bae1-3e839b2034ac tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:37.206791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ea52a38f-f473-40dd-bae1-3e839b2034ac tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.157544 Aug 02 09:08:37.207545 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 171/344] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:37 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:37.208849 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a0a3e256-da4c-4b98-a997-a51cc348b456 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:37.209454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a0a3e256-da4c-4b98-a997-a51cc348b456 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:37.215810 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a0a3e256-da4c-4b98-a997-a51cc348b456 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:37.216249 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a0a3e256-da4c-4b98-a997-a51cc348b456 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:37.217005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a0a3e256-da4c-4b98-a997-a51cc348b456 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:37.217437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a0a3e256-da4c-4b98-a997-a51cc348b456 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:37.357004 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a0a3e256-da4c-4b98-a997-a51cc348b456 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:37.364660 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a0a3e256-da4c-4b98-a997-a51cc348b456 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.160062 Aug 02 09:08:37.365215 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 174/345] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:37 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:37.379406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d075e280-62ff-495e-bf58-e7ef75ec0acc tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:37.380012 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d075e280-62ff-495e-bf58-e7ef75ec0acc tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:37.387311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d075e280-62ff-495e-bf58-e7ef75ec0acc tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:37.387811 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d075e280-62ff-495e-bf58-e7ef75ec0acc tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:37.388582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d075e280-62ff-495e-bf58-e7ef75ec0acc tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:37.389020 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d075e280-62ff-495e-bf58-e7ef75ec0acc tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:37.525522 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d075e280-62ff-495e-bf58-e7ef75ec0acc tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:37.532933 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d075e280-62ff-495e-bf58-e7ef75ec0acc tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.157452 Aug 02 09:08:37.533488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 172/346] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:37 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:38.229442 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e4acda3f-36e9-453d-9843-edc80666270e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:38.230140 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e4acda3f-36e9-453d-9843-edc80666270e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:38.237586 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4acda3f-36e9-453d-9843-edc80666270e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:38.238182 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4acda3f-36e9-453d-9843-edc80666270e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:38.239185 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4acda3f-36e9-453d-9843-edc80666270e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:38.239719 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4acda3f-36e9-453d-9843-edc80666270e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:38.386974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f012da0c-4043-49a5-8c51-1a85b5e89507 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:38.387641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f012da0c-4043-49a5-8c51-1a85b5e89507 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:38.392975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e4acda3f-36e9-453d-9843-edc80666270e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:38.394256 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f012da0c-4043-49a5-8c51-1a85b5e89507 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:38.394710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f012da0c-4043-49a5-8c51-1a85b5e89507 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:38.395510 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f012da0c-4043-49a5-8c51-1a85b5e89507 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:38.395941 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f012da0c-4043-49a5-8c51-1a85b5e89507 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:38.401297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e4acda3f-36e9-453d-9843-edc80666270e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.176603 Aug 02 09:08:38.401982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 175/347] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:38 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:38.540036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f012da0c-4043-49a5-8c51-1a85b5e89507 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:38.549415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f012da0c-4043-49a5-8c51-1a85b5e89507 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.167012 Aug 02 09:08:38.550606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 173/348] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:38 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:38.557646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3c6ee95d-6eb5-4bd7-ade8-140da52171d1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:38.558576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3c6ee95d-6eb5-4bd7-ade8-140da52171d1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:38.566687 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3c6ee95d-6eb5-4bd7-ade8-140da52171d1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:38.567172 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3c6ee95d-6eb5-4bd7-ade8-140da52171d1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:38.567978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3c6ee95d-6eb5-4bd7-ade8-140da52171d1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:38.568411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3c6ee95d-6eb5-4bd7-ade8-140da52171d1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:38.573909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:38.703560 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3c6ee95d-6eb5-4bd7-ade8-140da52171d1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:38.711623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3c6ee95d-6eb5-4bd7-ade8-140da52171d1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.158726 Aug 02 09:08:38.712238 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 176/349] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:38 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:39.422664 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9e54993d-358b-42af-81bd-185f3d2898eb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:39.423261 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9e54993d-358b-42af-81bd-185f3d2898eb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:39.429704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e54993d-358b-42af-81bd-185f3d2898eb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:39.430175 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e54993d-358b-42af-81bd-185f3d2898eb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:39.430951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e54993d-358b-42af-81bd-185f3d2898eb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:39.431379 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e54993d-358b-42af-81bd-185f3d2898eb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:39.574032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-42496de1-8375-49e0-b98b-25c5dcd0e0ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:39.574651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-42496de1-8375-49e0-b98b-25c5dcd0e0ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:39.576491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9e54993d-358b-42af-81bd-185f3d2898eb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:39.582383 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42496de1-8375-49e0-b98b-25c5dcd0e0ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:39.583038 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42496de1-8375-49e0-b98b-25c5dcd0e0ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:39.584372 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42496de1-8375-49e0-b98b-25c5dcd0e0ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:39.584818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42496de1-8375-49e0-b98b-25c5dcd0e0ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:39.585451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9e54993d-358b-42af-81bd-185f3d2898eb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.166519 Aug 02 09:08:39.586735 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 174/350] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:39 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:39.734110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d4d47578-b6b9-4c56-9872-cf310fac098a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:39.735056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d4d47578-b6b9-4c56-9872-cf310fac098a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:39.741667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4d47578-b6b9-4c56-9872-cf310fac098a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:39.742752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4d47578-b6b9-4c56-9872-cf310fac098a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:39.744330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4d47578-b6b9-4c56-9872-cf310fac098a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:39.744971 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4d47578-b6b9-4c56-9872-cf310fac098a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:39.747538 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-42496de1-8375-49e0-b98b-25c5dcd0e0ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:39.757369 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-42496de1-8375-49e0-b98b-25c5dcd0e0ba tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.188210 Aug 02 09:08:39.758520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 177/351] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:39 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:39.885772 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d4d47578-b6b9-4c56-9872-cf310fac098a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:39.893986 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d4d47578-b6b9-4c56-9872-cf310fac098a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.164351 Aug 02 09:08:39.894507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 175/352] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:39 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:40.607686 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-90a13119-a637-4ac2-8565-1f0d3e8b7f77 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:40.608381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-90a13119-a637-4ac2-8565-1f0d3e8b7f77 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:40.614606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-90a13119-a637-4ac2-8565-1f0d3e8b7f77 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:40.615042 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-90a13119-a637-4ac2-8565-1f0d3e8b7f77 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:40.620656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-90a13119-a637-4ac2-8565-1f0d3e8b7f77 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:40.620656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-90a13119-a637-4ac2-8565-1f0d3e8b7f77 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:40.750984 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-90a13119-a637-4ac2-8565-1f0d3e8b7f77 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:40.758652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-90a13119-a637-4ac2-8565-1f0d3e8b7f77 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.155123 Aug 02 09:08:40.759257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 178/353] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:40 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:40.779520 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6c97d3bd-2cc7-469d-af5e-9ac4f95da911 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:40.780119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6c97d3bd-2cc7-469d-af5e-9ac4f95da911 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:40.786965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6c97d3bd-2cc7-469d-af5e-9ac4f95da911 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:40.787350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6c97d3bd-2cc7-469d-af5e-9ac4f95da911 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:40.788107 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6c97d3bd-2cc7-469d-af5e-9ac4f95da911 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:40.788542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6c97d3bd-2cc7-469d-af5e-9ac4f95da911 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:40.915794 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9aa2b1b5-7ef9-4c2e-bd9b-a39fe6c3617a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:40.916550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9aa2b1b5-7ef9-4c2e-bd9b-a39fe6c3617a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:40.922515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9aa2b1b5-7ef9-4c2e-bd9b-a39fe6c3617a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:40.922965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9aa2b1b5-7ef9-4c2e-bd9b-a39fe6c3617a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:40.923732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9aa2b1b5-7ef9-4c2e-bd9b-a39fe6c3617a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:40.924431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9aa2b1b5-7ef9-4c2e-bd9b-a39fe6c3617a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:40.934903 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6c97d3bd-2cc7-469d-af5e-9ac4f95da911 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:40.943407 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6c97d3bd-2cc7-469d-af5e-9ac4f95da911 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.167653 Aug 02 09:08:40.944050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 176/354] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:40 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:41.054281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9aa2b1b5-7ef9-4c2e-bd9b-a39fe6c3617a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:41.062825 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9aa2b1b5-7ef9-4c2e-bd9b-a39fe6c3617a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.151498 Aug 02 09:08:41.063394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 179/355] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:40 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:41.779867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6e4230db-31c2-4b2b-962b-e9b378471fe2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:41.780465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6e4230db-31c2-4b2b-962b-e9b378471fe2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:41.786802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6e4230db-31c2-4b2b-962b-e9b378471fe2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:41.787249 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6e4230db-31c2-4b2b-962b-e9b378471fe2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:41.788010 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6e4230db-31c2-4b2b-962b-e9b378471fe2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:41.788438 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6e4230db-31c2-4b2b-962b-e9b378471fe2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:41.933485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6e4230db-31c2-4b2b-962b-e9b378471fe2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:41.941406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6e4230db-31c2-4b2b-962b-e9b378471fe2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.165424 Aug 02 09:08:41.942429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 177/356] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:41 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:41.964635 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-894f8454-a837-4557-a560-ea9e1d627466 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:41.965281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-894f8454-a837-4557-a560-ea9e1d627466 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:41.971930 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-894f8454-a837-4557-a560-ea9e1d627466 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:41.972412 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-894f8454-a837-4557-a560-ea9e1d627466 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:41.973220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-894f8454-a837-4557-a560-ea9e1d627466 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:41.973659 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-894f8454-a837-4557-a560-ea9e1d627466 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:42.084886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3c6f4338-7ba8-46d5-a61d-cf7e07f7b7a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:42.085529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3c6f4338-7ba8-46d5-a61d-cf7e07f7b7a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:42.092838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3c6f4338-7ba8-46d5-a61d-cf7e07f7b7a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:42.097712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3c6f4338-7ba8-46d5-a61d-cf7e07f7b7a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:42.097712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3c6f4338-7ba8-46d5-a61d-cf7e07f7b7a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:42.097712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3c6f4338-7ba8-46d5-a61d-cf7e07f7b7a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:42.112690 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-894f8454-a837-4557-a560-ea9e1d627466 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:42.123242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-894f8454-a837-4557-a560-ea9e1d627466 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.162364 Aug 02 09:08:42.123828 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 180/357] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:41 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:42.235742 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3c6f4338-7ba8-46d5-a61d-cf7e07f7b7a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:42.244078 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3c6f4338-7ba8-46d5-a61d-cf7e07f7b7a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.162961 Aug 02 09:08:42.244775 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 178/358] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:42 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:42.966113 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9ad99eee-65c8-4288-b016-06c12f07deaa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:42.966783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9ad99eee-65c8-4288-b016-06c12f07deaa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:42.974032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9ad99eee-65c8-4288-b016-06c12f07deaa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:42.974486 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9ad99eee-65c8-4288-b016-06c12f07deaa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:42.975276 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9ad99eee-65c8-4288-b016-06c12f07deaa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:42.975750 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9ad99eee-65c8-4288-b016-06c12f07deaa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:43.115727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9ad99eee-65c8-4288-b016-06c12f07deaa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:43.124440 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9ad99eee-65c8-4288-b016-06c12f07deaa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.163069 Aug 02 09:08:43.125054 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 181/359] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:42 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:43.144015 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ae1c053c-fbd1-48c1-b879-a209c6bc8c50 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:43.144656 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ae1c053c-fbd1-48c1-b879-a209c6bc8c50 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:43.151739 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae1c053c-fbd1-48c1-b879-a209c6bc8c50 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:43.152200 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae1c053c-fbd1-48c1-b879-a209c6bc8c50 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:43.152998 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae1c053c-fbd1-48c1-b879-a209c6bc8c50 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:43.153439 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae1c053c-fbd1-48c1-b879-a209c6bc8c50 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:43.266160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cef17303-86ff-4b8b-9c85-7f8d81a00fa4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:43.267554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cef17303-86ff-4b8b-9c85-7f8d81a00fa4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:43.273031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cef17303-86ff-4b8b-9c85-7f8d81a00fa4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:43.273379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cef17303-86ff-4b8b-9c85-7f8d81a00fa4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:43.274209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cef17303-86ff-4b8b-9c85-7f8d81a00fa4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:43.274805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cef17303-86ff-4b8b-9c85-7f8d81a00fa4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:43.297680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ae1c053c-fbd1-48c1-b879-a209c6bc8c50 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:43.306571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ae1c053c-fbd1-48c1-b879-a209c6bc8c50 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.166523 Aug 02 09:08:43.307160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 179/360] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:43 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:43.416443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-cef17303-86ff-4b8b-9c85-7f8d81a00fa4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:43.424427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cef17303-86ff-4b8b-9c85-7f8d81a00fa4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.162195 Aug 02 09:08:43.424958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 182/361] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:43 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:44.146176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e91a36a0-25d2-4fb8-915a-bc0259e410ad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:44.146803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e91a36a0-25d2-4fb8-915a-bc0259e410ad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:44.153389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e91a36a0-25d2-4fb8-915a-bc0259e410ad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:44.153833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e91a36a0-25d2-4fb8-915a-bc0259e410ad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:44.154628 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e91a36a0-25d2-4fb8-915a-bc0259e410ad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:44.155253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e91a36a0-25d2-4fb8-915a-bc0259e410ad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:44.293825 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e91a36a0-25d2-4fb8-915a-bc0259e410ad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:44.301968 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e91a36a0-25d2-4fb8-915a-bc0259e410ad tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.159545 Aug 02 09:08:44.319230 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 180/362] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:44 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:44.327466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-97c61e63-a979-4b6a-9ecf-8eee9ac2f827 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:44.328077 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-97c61e63-a979-4b6a-9ecf-8eee9ac2f827 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:44.335257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97c61e63-a979-4b6a-9ecf-8eee9ac2f827 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:44.335456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97c61e63-a979-4b6a-9ecf-8eee9ac2f827 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:44.336348 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97c61e63-a979-4b6a-9ecf-8eee9ac2f827 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:44.336666 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97c61e63-a979-4b6a-9ecf-8eee9ac2f827 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:44.446296 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-62e3f4e6-3da1-45bc-91ab-3d41e6e9e943 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:44.446827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-62e3f4e6-3da1-45bc-91ab-3d41e6e9e943 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:44.453479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-62e3f4e6-3da1-45bc-91ab-3d41e6e9e943 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:44.464194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-62e3f4e6-3da1-45bc-91ab-3d41e6e9e943 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:44.464194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-62e3f4e6-3da1-45bc-91ab-3d41e6e9e943 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:44.464194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-62e3f4e6-3da1-45bc-91ab-3d41e6e9e943 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:44.477964 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-97c61e63-a979-4b6a-9ecf-8eee9ac2f827 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:44.486827 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-97c61e63-a979-4b6a-9ecf-8eee9ac2f827 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.163276 Aug 02 09:08:44.499853 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 183/363] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:44 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:44.598106 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-62e3f4e6-3da1-45bc-91ab-3d41e6e9e943 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:44.605854 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-62e3f4e6-3da1-45bc-91ab-3d41e6e9e943 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.163585 Aug 02 09:08:44.606455 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 181/364] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:44 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:45.324817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7e1f1d84-8eeb-47bd-8215-8d564c654418 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:45.325610 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7e1f1d84-8eeb-47bd-8215-8d564c654418 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:45.332037 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d84-8eeb-47bd-8215-8d564c654418 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:45.333835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d84-8eeb-47bd-8215-8d564c654418 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:45.333835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d84-8eeb-47bd-8215-8d564c654418 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:45.333835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d84-8eeb-47bd-8215-8d564c654418 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:45.476132 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7e1f1d84-8eeb-47bd-8215-8d564c654418 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:45.484136 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7e1f1d84-8eeb-47bd-8215-8d564c654418 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.163841 Aug 02 09:08:45.484721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 184/365] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:45 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:45.508900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-57a1ebc3-f2d1-45c0-a6bb-c36ccc23ec3d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:45.509549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-57a1ebc3-f2d1-45c0-a6bb-c36ccc23ec3d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:45.516243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-57a1ebc3-f2d1-45c0-a6bb-c36ccc23ec3d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:45.516686 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-57a1ebc3-f2d1-45c0-a6bb-c36ccc23ec3d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:45.517465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-57a1ebc3-f2d1-45c0-a6bb-c36ccc23ec3d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:45.517917 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-57a1ebc3-f2d1-45c0-a6bb-c36ccc23ec3d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:45.522239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:45.627756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1419df37-4cf8-459b-81f3-14b544498cc7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:45.628370 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1419df37-4cf8-459b-81f3-14b544498cc7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:45.634713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1419df37-4cf8-459b-81f3-14b544498cc7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:45.635166 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1419df37-4cf8-459b-81f3-14b544498cc7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:45.636106 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1419df37-4cf8-459b-81f3-14b544498cc7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:45.636557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1419df37-4cf8-459b-81f3-14b544498cc7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:45.661693 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-57a1ebc3-f2d1-45c0-a6bb-c36ccc23ec3d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:45.670523 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-57a1ebc3-f2d1-45c0-a6bb-c36ccc23ec3d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.165819 Aug 02 09:08:45.671107 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 182/366] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:45 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:45.796481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1419df37-4cf8-459b-81f3-14b544498cc7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:45.809512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1419df37-4cf8-459b-81f3-14b544498cc7 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.185535 Aug 02 09:08:45.810479 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 185/367] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:45 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:46.507957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d20c2934-b114-49a1-8054-8d5bdc1c616a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:46.508495 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d20c2934-b114-49a1-8054-8d5bdc1c616a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:46.515195 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d20c2934-b114-49a1-8054-8d5bdc1c616a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:46.515843 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d20c2934-b114-49a1-8054-8d5bdc1c616a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:46.516420 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d20c2934-b114-49a1-8054-8d5bdc1c616a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:46.516856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d20c2934-b114-49a1-8054-8d5bdc1c616a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:46.669877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d20c2934-b114-49a1-8054-8d5bdc1c616a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:46.677741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d20c2934-b114-49a1-8054-8d5bdc1c616a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.173717 Aug 02 09:08:46.678345 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 183/368] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:46 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:46.694996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9120b63c-c2ed-4ad8-abef-bd5c62b0ade8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:46.695756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9120b63c-c2ed-4ad8-abef-bd5c62b0ade8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:46.702413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9120b63c-c2ed-4ad8-abef-bd5c62b0ade8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:46.702821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9120b63c-c2ed-4ad8-abef-bd5c62b0ade8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:46.703654 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9120b63c-c2ed-4ad8-abef-bd5c62b0ade8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:46.704108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9120b63c-c2ed-4ad8-abef-bd5c62b0ade8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:46.833400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a12919cd-58af-4164-b2d0-b91bbc9aea84 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:46.834604 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a12919cd-58af-4164-b2d0-b91bbc9aea84 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:46.842434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a12919cd-58af-4164-b2d0-b91bbc9aea84 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:46.843191 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a12919cd-58af-4164-b2d0-b91bbc9aea84 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:46.844416 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a12919cd-58af-4164-b2d0-b91bbc9aea84 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:46.845121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a12919cd-58af-4164-b2d0-b91bbc9aea84 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:46.872864 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9120b63c-c2ed-4ad8-abef-bd5c62b0ade8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:46.881698 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9120b63c-c2ed-4ad8-abef-bd5c62b0ade8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.190526 Aug 02 09:08:46.882550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 186/369] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:46 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:47.000558 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a12919cd-58af-4164-b2d0-b91bbc9aea84 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:47.008851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a12919cd-58af-4164-b2d0-b91bbc9aea84 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.179394 Aug 02 09:08:47.010634 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 184/370] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:46 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:47.701103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e0dc90f9-2e65-43cb-b9a6-68411e3bf9f2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:47.701711 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e0dc90f9-2e65-43cb-b9a6-68411e3bf9f2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:47.708138 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e0dc90f9-2e65-43cb-b9a6-68411e3bf9f2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:47.708583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e0dc90f9-2e65-43cb-b9a6-68411e3bf9f2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:47.709349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e0dc90f9-2e65-43cb-b9a6-68411e3bf9f2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:47.709788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e0dc90f9-2e65-43cb-b9a6-68411e3bf9f2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:47.847292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e0dc90f9-2e65-43cb-b9a6-68411e3bf9f2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:47.855856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e0dc90f9-2e65-43cb-b9a6-68411e3bf9f2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.158953 Aug 02 09:08:47.856440 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 187/371] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:47 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:47.903457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-53e3f7c0-335c-42f5-9a4a-339d4c9d9eb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:47.904067 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-53e3f7c0-335c-42f5-9a4a-339d4c9d9eb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:47.912108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53e3f7c0-335c-42f5-9a4a-339d4c9d9eb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:47.912108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53e3f7c0-335c-42f5-9a4a-339d4c9d9eb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:47.912807 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53e3f7c0-335c-42f5-9a4a-339d4c9d9eb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:47.913243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-53e3f7c0-335c-42f5-9a4a-339d4c9d9eb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:48.030915 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-10e88183-56d9-4b3f-91ce-5388d7c5248d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:48.031537 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-10e88183-56d9-4b3f-91ce-5388d7c5248d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:48.043396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-10e88183-56d9-4b3f-91ce-5388d7c5248d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:48.044070 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-10e88183-56d9-4b3f-91ce-5388d7c5248d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:48.045591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-10e88183-56d9-4b3f-91ce-5388d7c5248d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:48.045591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-10e88183-56d9-4b3f-91ce-5388d7c5248d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:48.050877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-53e3f7c0-335c-42f5-9a4a-339d4c9d9eb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:48.062253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-53e3f7c0-335c-42f5-9a4a-339d4c9d9eb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.162538 Aug 02 09:08:48.079031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 185/372] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:47 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:48.186369 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-10e88183-56d9-4b3f-91ce-5388d7c5248d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:48.193946 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-10e88183-56d9-4b3f-91ce-5388d7c5248d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.167072 Aug 02 09:08:48.194516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 188/373] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:48 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:48.876671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3c70b240-96de-4185-9619-53b9ca7552f4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:48.877268 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3c70b240-96de-4185-9619-53b9ca7552f4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:48.879170 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=76 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:48.883918 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3c70b240-96de-4185-9619-53b9ca7552f4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:48.884356 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3c70b240-96de-4185-9619-53b9ca7552f4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:48.885110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3c70b240-96de-4185-9619-53b9ca7552f4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:48.885629 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3c70b240-96de-4185-9619-53b9ca7552f4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:49.031610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3c70b240-96de-4185-9619-53b9ca7552f4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:49.041353 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3c70b240-96de-4185-9619-53b9ca7552f4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.168457 Aug 02 09:08:49.045491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 186/374] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:48 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:49.092875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-eb416e59-cfde-471f-8b87-b31735fca470 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:49.093494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-eb416e59-cfde-471f-8b87-b31735fca470 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:49.100088 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eb416e59-cfde-471f-8b87-b31735fca470 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:49.100543 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eb416e59-cfde-471f-8b87-b31735fca470 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:49.101321 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eb416e59-cfde-471f-8b87-b31735fca470 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:49.102357 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eb416e59-cfde-471f-8b87-b31735fca470 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:49.217422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9c74c0fe-509b-4aa6-8cce-0f15ca1e3f8a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:49.218246 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9c74c0fe-509b-4aa6-8cce-0f15ca1e3f8a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:49.224331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9c74c0fe-509b-4aa6-8cce-0f15ca1e3f8a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:49.224767 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9c74c0fe-509b-4aa6-8cce-0f15ca1e3f8a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:49.225546 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9c74c0fe-509b-4aa6-8cce-0f15ca1e3f8a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:49.226010 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9c74c0fe-509b-4aa6-8cce-0f15ca1e3f8a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:49.249272 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-eb416e59-cfde-471f-8b87-b31735fca470 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:49.257279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-eb416e59-cfde-471f-8b87-b31735fca470 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.171026 Aug 02 09:08:49.257863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 189/375] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:49 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:49.370406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9c74c0fe-509b-4aa6-8cce-0f15ca1e3f8a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:49.378191 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9c74c0fe-509b-4aa6-8cce-0f15ca1e3f8a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.164707 Aug 02 09:08:49.378778 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 187/376] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:49 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:50.073435 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6e157bd3-e751-46be-8287-6c6b0edaf110 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:50.074544 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6e157bd3-e751-46be-8287-6c6b0edaf110 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:50.076346 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=76 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:50.081385 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e157bd3-e751-46be-8287-6c6b0edaf110 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.081837 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e157bd3-e751-46be-8287-6c6b0edaf110 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.082628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e157bd3-e751-46be-8287-6c6b0edaf110 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.083054 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e157bd3-e751-46be-8287-6c6b0edaf110 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.278939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fb0a991b-2740-468e-95a6-5047ad842958 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:50.279567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fb0a991b-2740-468e-95a6-5047ad842958 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:50.286653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fb0a991b-2740-468e-95a6-5047ad842958 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.287184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fb0a991b-2740-468e-95a6-5047ad842958 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.287963 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fb0a991b-2740-468e-95a6-5047ad842958 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.288402 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fb0a991b-2740-468e-95a6-5047ad842958 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.294643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6e157bd3-e751-46be-8287-6c6b0edaf110 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:50.303001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6e157bd3-e751-46be-8287-6c6b0edaf110 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.234147 Aug 02 09:08:50.303600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 190/377] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:50 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:50.400005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e6727885-e173-480d-8efb-934c607369d9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:50.400643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e6727885-e173-480d-8efb-934c607369d9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:50.407217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e6727885-e173-480d-8efb-934c607369d9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.407665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e6727885-e173-480d-8efb-934c607369d9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.408569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e6727885-e173-480d-8efb-934c607369d9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:50.408948 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e6727885-e173-480d-8efb-934c607369d9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:50.439120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fb0a991b-2740-468e-95a6-5047ad842958 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:50.451761 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fb0a991b-2740-468e-95a6-5047ad842958 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.176605 Aug 02 09:08:50.452785 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 188/378] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:50 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:50.563235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e6727885-e173-480d-8efb-934c607369d9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:50.571188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e6727885-e173-480d-8efb-934c607369d9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.175094 Aug 02 09:08:50.571776 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 191/379] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:50 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:51.325050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d56fafe9-2436-40e5-89dd-f1bd09a05653 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:51.325687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d56fafe9-2436-40e5-89dd-f1bd09a05653 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:51.332831 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d56fafe9-2436-40e5-89dd-f1bd09a05653 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.333383 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d56fafe9-2436-40e5-89dd-f1bd09a05653 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.334182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d56fafe9-2436-40e5-89dd-f1bd09a05653 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.334625 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d56fafe9-2436-40e5-89dd-f1bd09a05653 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.474242 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d56fafe9-2436-40e5-89dd-f1bd09a05653 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:51.475837 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-eca0ff9d-5d0e-47ac-af78-4ea2e70b29d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:51.477180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-eca0ff9d-5d0e-47ac-af78-4ea2e70b29d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:51.483215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d56fafe9-2436-40e5-89dd-f1bd09a05653 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.162028 Aug 02 09:08:51.483526 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eca0ff9d-5d0e-47ac-af78-4ea2e70b29d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.483989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 189/380] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:51 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:51.484129 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eca0ff9d-5d0e-47ac-af78-4ea2e70b29d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.484755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eca0ff9d-5d0e-47ac-af78-4ea2e70b29d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.485196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eca0ff9d-5d0e-47ac-af78-4ea2e70b29d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.597801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bc71f6c6-a71c-4fe2-b740-d019b0f56a15 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:51.599088 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bc71f6c6-a71c-4fe2-b740-d019b0f56a15 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:51.610154 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc71f6c6-a71c-4fe2-b740-d019b0f56a15 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.611171 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc71f6c6-a71c-4fe2-b740-d019b0f56a15 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.612654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc71f6c6-a71c-4fe2-b740-d019b0f56a15 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:51.613527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc71f6c6-a71c-4fe2-b740-d019b0f56a15 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:51.698160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-eca0ff9d-5d0e-47ac-af78-4ea2e70b29d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:51.702889 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:51.707821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-eca0ff9d-5d0e-47ac-af78-4ea2e70b29d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.236372 Aug 02 09:08:51.708608 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 192/381] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:51 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:51.778441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bc71f6c6-a71c-4fe2-b740-d019b0f56a15 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:51.786216 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bc71f6c6-a71c-4fe2-b740-d019b0f56a15 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.196550 Aug 02 09:08:51.786801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 190/382] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:51 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:08:52.070291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-3259e562-3e65-4814-ae97-c5500a22a8ea req-928092de-7cbf-42a9-8beb-e378ba02a077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df72120-5785-40dc-94eb-4fb66b4a8fc0", "name": "network-vif-plugged", "status": "completed", "tag": "4b8a4403-3f1c-4e67-ba1b-5cb012dccd2f"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:08:52.081297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-3259e562-3e65-4814-ae97-c5500a22a8ea req-928092de-7cbf-42a9-8beb-e378ba02a077 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.081748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-3259e562-3e65-4814-ae97-c5500a22a8ea req-928092de-7cbf-42a9-8beb-e378ba02a077 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.092965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-3259e562-3e65-4814-ae97-c5500a22a8ea req-928092de-7cbf-42a9-8beb-e378ba02a077 service nova] Creating event network-vif-plugged:4b8a4403-3f1c-4e67-ba1b-5cb012dccd2f for instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 on hv-cinder-84713 Aug 02 09:08:52.097968 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-3259e562-3e65-4814-ae97-c5500a22a8ea req-928092de-7cbf-42a9-8beb-e378ba02a077 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032163 Aug 02 09:08:52.103338 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 193/383] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:52.507118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-171d68a4-6ce1-4535-baca-6a060db3b9df tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:52.507827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-171d68a4-6ce1-4535-baca-6a060db3b9df tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:52.516277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-171d68a4-6ce1-4535-baca-6a060db3b9df tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.516724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-171d68a4-6ce1-4535-baca-6a060db3b9df tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.517578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-171d68a4-6ce1-4535-baca-6a060db3b9df tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.518065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-171d68a4-6ce1-4535-baca-6a060db3b9df tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.701785 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-171d68a4-6ce1-4535-baca-6a060db3b9df tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:52.710223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-171d68a4-6ce1-4535-baca-6a060db3b9df tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.207178 Aug 02 09:08:52.711347 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 191/384] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:52 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:52.737756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-76cfca63-e322-46ef-a7f4-c9d5c7f2bb70 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:52.739450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-76cfca63-e322-46ef-a7f4-c9d5c7f2bb70 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:52.748699 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76cfca63-e322-46ef-a7f4-c9d5c7f2bb70 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.749393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76cfca63-e322-46ef-a7f4-c9d5c7f2bb70 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.750980 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76cfca63-e322-46ef-a7f4-c9d5c7f2bb70 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.752005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76cfca63-e322-46ef-a7f4-c9d5c7f2bb70 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.814744 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8c34ef12-5efa-4548-b3bc-04ba25014fb1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:52.815860 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8c34ef12-5efa-4548-b3bc-04ba25014fb1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:52.838775 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8c34ef12-5efa-4548-b3bc-04ba25014fb1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.845971 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8c34ef12-5efa-4548-b3bc-04ba25014fb1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.849081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8c34ef12-5efa-4548-b3bc-04ba25014fb1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:52.854360 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8c34ef12-5efa-4548-b3bc-04ba25014fb1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:52.967566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-76cfca63-e322-46ef-a7f4-c9d5c7f2bb70 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:52.975989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-76cfca63-e322-46ef-a7f4-c9d5c7f2bb70 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.247982 Aug 02 09:08:52.977245 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 194/385] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:52 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:53.079348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8c34ef12-5efa-4548-b3bc-04ba25014fb1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:53.087227 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8c34ef12-5efa-4548-b3bc-04ba25014fb1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1359 microversion: 2.1 time: 0.281159 Aug 02 09:08:53.087807 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 192/386] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:52 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:53.740337 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7c85244e-822f-4660-8e0c-f5ea3e12f0a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:53.740885 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7c85244e-822f-4660-8e0c-f5ea3e12f0a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:53.747823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7c85244e-822f-4660-8e0c-f5ea3e12f0a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:53.748265 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7c85244e-822f-4660-8e0c-f5ea3e12f0a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:53.749033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7c85244e-822f-4660-8e0c-f5ea3e12f0a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:53.749456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7c85244e-822f-4660-8e0c-f5ea3e12f0a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:53.900405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7c85244e-822f-4660-8e0c-f5ea3e12f0a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:53.915649 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7c85244e-822f-4660-8e0c-f5ea3e12f0a8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.178910 Aug 02 09:08:53.916582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 195/387] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:53 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:53.999610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1778ac18-4b9a-428f-9dcc-7637793d34a0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.000377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1778ac18-4b9a-428f-9dcc-7637793d34a0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:54.007385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1778ac18-4b9a-428f-9dcc-7637793d34a0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.011466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1778ac18-4b9a-428f-9dcc-7637793d34a0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.011466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1778ac18-4b9a-428f-9dcc-7637793d34a0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.011466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1778ac18-4b9a-428f-9dcc-7637793d34a0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.115533 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a30279ba-e8b9-46b4-98f6-5894a39d9daa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.116208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a30279ba-e8b9-46b4-98f6-5894a39d9daa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:54.123731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a30279ba-e8b9-46b4-98f6-5894a39d9daa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.124183 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a30279ba-e8b9-46b4-98f6-5894a39d9daa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.124967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a30279ba-e8b9-46b4-98f6-5894a39d9daa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.125408 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a30279ba-e8b9-46b4-98f6-5894a39d9daa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.167398 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1778ac18-4b9a-428f-9dcc-7637793d34a0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:54.175482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1778ac18-4b9a-428f-9dcc-7637793d34a0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.179850 Aug 02 09:08:54.176055 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 193/388] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:53 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:54.277676 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a30279ba-e8b9-46b4-98f6-5894a39d9daa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:54.285217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a30279ba-e8b9-46b4-98f6-5894a39d9daa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1550 microversion: 2.1 time: 0.173536 Aug 02 09:08:54.285783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 196/389] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:54 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:54.307597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c99ca38d-8896-425c-86fb-a721cec267ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.308432 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c99ca38d-8896-425c-86fb-a721cec267ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:54.317088 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c99ca38d-8896-425c-86fb-a721cec267ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.318283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c99ca38d-8896-425c-86fb-a721cec267ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.318402 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c99ca38d-8896-425c-86fb-a721cec267ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.318743 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c99ca38d-8896-425c-86fb-a721cec267ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.466153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c99ca38d-8896-425c-86fb-a721cec267ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:54.474633 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c99ca38d-8896-425c-86fb-a721cec267ee tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1550 microversion: 2.1 time: 0.170804 Aug 02 09:08:54.475117 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 194/390] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:54 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1550 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:54.495600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.500391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:54.501157 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Searching by: {'deleted': False, 'project_id': '5132918a404e4b6ab13577698e319630'} {{(pid=118366) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 09:08:54.508765 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.509200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.510222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.510660 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.599726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.multi_cell_list [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 09:08:54.697723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-94ffea93-ed29-4a67-b48a-828a43ff0ff9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206476 Aug 02 09:08:54.698384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 197/391] 10.222.0.46 () {58 vars in 1125 bytes} [Tue Aug 2 09:08:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:54.709782 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c6a5ed4d-378a-4c4e-8db3-9964fe84120a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.710429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c6a5ed4d-378a-4c4e-8db3-9964fe84120a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:54.716783 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c6a5ed4d-378a-4c4e-8db3-9964fe84120a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.717318 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c6a5ed4d-378a-4c4e-8db3-9964fe84120a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.718103 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c6a5ed4d-378a-4c4e-8db3-9964fe84120a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.718534 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c6a5ed4d-378a-4c4e-8db3-9964fe84120a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.852488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c6a5ed4d-378a-4c4e-8db3-9964fe84120a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:54.860247 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c6a5ed4d-378a-4c4e-8db3-9964fe84120a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1550 microversion: 2.1 time: 0.154211 Aug 02 09:08:54.860827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 195/392] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:54 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:54.947767 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4dfde9a3-572f-4f68-8cd9-636307219d0e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.948426 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4dfde9a3-572f-4f68-8cd9-636307219d0e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:54.955670 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4dfde9a3-572f-4f68-8cd9-636307219d0e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.956115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4dfde9a3-572f-4f68-8cd9-636307219d0e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.956875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4dfde9a3-572f-4f68-8cd9-636307219d0e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.957299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4dfde9a3-572f-4f68-8cd9-636307219d0e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:55.097928 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4dfde9a3-572f-4f68-8cd9-636307219d0e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:55.106205 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4dfde9a3-572f-4f68-8cd9-636307219d0e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.162421 Aug 02 09:08:55.106702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 198/393] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:54 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:55.207848 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-456e5c18-57ef-4c7a-bddc-35d9ce7ad8c6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:55.208670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-456e5c18-57ef-4c7a-bddc-35d9ce7ad8c6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:55.218023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-456e5c18-57ef-4c7a-bddc-35d9ce7ad8c6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:55.218466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-456e5c18-57ef-4c7a-bddc-35d9ce7ad8c6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:55.219235 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-456e5c18-57ef-4c7a-bddc-35d9ce7ad8c6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:55.219663 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-456e5c18-57ef-4c7a-bddc-35d9ce7ad8c6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:55.375973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-456e5c18-57ef-4c7a-bddc-35d9ce7ad8c6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:55.384161 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-456e5c18-57ef-4c7a-bddc-35d9ce7ad8c6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.184328 Aug 02 09:08:55.384750 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 196/394] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:55 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:56.129064 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7d7c9acd-b900-46aa-bef3-5525a437e7bd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:56.129638 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7d7c9acd-b900-46aa-bef3-5525a437e7bd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:56.135872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7d7c9acd-b900-46aa-bef3-5525a437e7bd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:56.136324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7d7c9acd-b900-46aa-bef3-5525a437e7bd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:56.137102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7d7c9acd-b900-46aa-bef3-5525a437e7bd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:56.137536 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7d7c9acd-b900-46aa-bef3-5525a437e7bd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:56.273801 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7d7c9acd-b900-46aa-bef3-5525a437e7bd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:56.281636 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7d7c9acd-b900-46aa-bef3-5525a437e7bd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.156456 Aug 02 09:08:56.282248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 199/395] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:56 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:56.407102 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-368aba6f-18cb-41aa-b36b-583aa263448b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:56.407710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-368aba6f-18cb-41aa-b36b-583aa263448b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:56.415407 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-368aba6f-18cb-41aa-b36b-583aa263448b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:56.415853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-368aba6f-18cb-41aa-b36b-583aa263448b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:56.416630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-368aba6f-18cb-41aa-b36b-583aa263448b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:56.417054 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-368aba6f-18cb-41aa-b36b-583aa263448b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:56.565028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-368aba6f-18cb-41aa-b36b-583aa263448b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:56.573960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-368aba6f-18cb-41aa-b36b-583aa263448b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.171916 Aug 02 09:08:56.575331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 197/396] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:56 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:57.303313 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-94ab009c-774f-48e8-a72f-2f080e99717a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:57.304426 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-94ab009c-774f-48e8-a72f-2f080e99717a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:57.310783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94ab009c-774f-48e8-a72f-2f080e99717a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:57.311232 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94ab009c-774f-48e8-a72f-2f080e99717a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:57.312597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94ab009c-774f-48e8-a72f-2f080e99717a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:57.312597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94ab009c-774f-48e8-a72f-2f080e99717a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:57.453218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-94ab009c-774f-48e8-a72f-2f080e99717a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:57.460936 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-94ab009c-774f-48e8-a72f-2f080e99717a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.161475 Aug 02 09:08:57.461508 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 200/397] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:57 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:57.599194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-648e9d5d-9ea1-4d19-927b-c0ecf078c444 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:57.599843 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-648e9d5d-9ea1-4d19-927b-c0ecf078c444 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:57.610188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-648e9d5d-9ea1-4d19-927b-c0ecf078c444 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:57.610868 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-648e9d5d-9ea1-4d19-927b-c0ecf078c444 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:57.612134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-648e9d5d-9ea1-4d19-927b-c0ecf078c444 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:57.612851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-648e9d5d-9ea1-4d19-927b-c0ecf078c444 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:57.753496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-648e9d5d-9ea1-4d19-927b-c0ecf078c444 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:57.757254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:57.761456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-648e9d5d-9ea1-4d19-927b-c0ecf078c444 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.168871 Aug 02 09:08:57.762036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 198/398] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:57 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:58.482560 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-22825dca-74a3-4fad-bb4b-d2639bd2e681 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:58.483165 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-22825dca-74a3-4fad-bb4b-d2639bd2e681 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:58.489171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22825dca-74a3-4fad-bb4b-d2639bd2e681 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:58.489616 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22825dca-74a3-4fad-bb4b-d2639bd2e681 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:58.490405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22825dca-74a3-4fad-bb4b-d2639bd2e681 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:58.490840 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22825dca-74a3-4fad-bb4b-d2639bd2e681 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:58.625155 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-22825dca-74a3-4fad-bb4b-d2639bd2e681 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:58.632590 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-22825dca-74a3-4fad-bb4b-d2639bd2e681 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.153816 Aug 02 09:08:58.633161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 201/399] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:58 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:58.781793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-013075d0-aa1a-4da0-ba7b-1d2573cc7d65 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:58.782423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-013075d0-aa1a-4da0-ba7b-1d2573cc7d65 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:58.789780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-013075d0-aa1a-4da0-ba7b-1d2573cc7d65 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:58.790257 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-013075d0-aa1a-4da0-ba7b-1d2573cc7d65 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:58.791020 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-013075d0-aa1a-4da0-ba7b-1d2573cc7d65 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:58.791449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-013075d0-aa1a-4da0-ba7b-1d2573cc7d65 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:58.921324 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-013075d0-aa1a-4da0-ba7b-1d2573cc7d65 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:58.935101 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-013075d0-aa1a-4da0-ba7b-1d2573cc7d65 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.157075 Aug 02 09:08:58.936012 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 199/400] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:58 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:59.654053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-18333e5e-57d2-4fd8-8cff-0a6afcce3fd0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:59.654600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-18333e5e-57d2-4fd8-8cff-0a6afcce3fd0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:59.660982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18333e5e-57d2-4fd8-8cff-0a6afcce3fd0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:59.661428 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18333e5e-57d2-4fd8-8cff-0a6afcce3fd0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:59.662253 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18333e5e-57d2-4fd8-8cff-0a6afcce3fd0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:59.662693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18333e5e-57d2-4fd8-8cff-0a6afcce3fd0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:59.804913 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-18333e5e-57d2-4fd8-8cff-0a6afcce3fd0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:08:59.812534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-18333e5e-57d2-4fd8-8cff-0a6afcce3fd0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.162760 Aug 02 09:08:59.813115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 202/401] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:59 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:59.956395 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3e193350-b5d0-4100-b148-e9d1638a5aad tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:59.956989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3e193350-b5d0-4100-b148-e9d1638a5aad tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:08:59.964098 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e193350-b5d0-4100-b148-e9d1638a5aad tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:59.965697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e193350-b5d0-4100-b148-e9d1638a5aad tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:59.966888 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e193350-b5d0-4100-b148-e9d1638a5aad tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:59.967351 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e193350-b5d0-4100-b148-e9d1638a5aad tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:00.106380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3e193350-b5d0-4100-b148-e9d1638a5aad tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:00.113999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3e193350-b5d0-4100-b148-e9d1638a5aad tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1318 microversion: 2.1 time: 0.161608 Aug 02 09:09:00.114499 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 200/402] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:08:59 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:00.834251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-30c54133-23cf-4f47-b9b9-7bc7b7710b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:00.834917 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-30c54133-23cf-4f47-b9b9-7bc7b7710b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:00.841330 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30c54133-23cf-4f47-b9b9-7bc7b7710b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:00.841775 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30c54133-23cf-4f47-b9b9-7bc7b7710b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:00.842567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30c54133-23cf-4f47-b9b9-7bc7b7710b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:00.843032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30c54133-23cf-4f47-b9b9-7bc7b7710b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:00.972810 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-30c54133-23cf-4f47-b9b9-7bc7b7710b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:00.981088 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-30c54133-23cf-4f47-b9b9-7bc7b7710b13 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.150681 Aug 02 09:09:00.981643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 203/403] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:00 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:01.135245 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0848e915-85cb-4daf-9320-05f559c18b2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:01.136035 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0848e915-85cb-4daf-9320-05f559c18b2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:01.142424 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0848e915-85cb-4daf-9320-05f559c18b2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:01.142884 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0848e915-85cb-4daf-9320-05f559c18b2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:01.144345 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0848e915-85cb-4daf-9320-05f559c18b2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:01.144345 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0848e915-85cb-4daf-9320-05f559c18b2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:01.278981 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0848e915-85cb-4daf-9320-05f559c18b2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:01.286900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0848e915-85cb-4daf-9320-05f559c18b2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1507 microversion: 2.1 time: 0.155699 Aug 02 09:09:01.287485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 201/404] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:01 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:02.002646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5fef56fe-3a03-453a-a3cd-a1e64591ace1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:02.003470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5fef56fe-3a03-453a-a3cd-a1e64591ace1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:02.028162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5fef56fe-3a03-453a-a3cd-a1e64591ace1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.028162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5fef56fe-3a03-453a-a3cd-a1e64591ace1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:02.028162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5fef56fe-3a03-453a-a3cd-a1e64591ace1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.028162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5fef56fe-3a03-453a-a3cd-a1e64591ace1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:02.243141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5fef56fe-3a03-453a-a3cd-a1e64591ace1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:02.254982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5fef56fe-3a03-453a-a3cd-a1e64591ace1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.256317 Aug 02 09:09:02.259246 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 204/405] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:01 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:02.468593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e8e30b70-10cf-4d08-88bf-13ae8cf70099 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53b42842-50d1-4468-b7bb-16f543c0f862"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:02.471994 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e8e30b70-10cf-4d08-88bf-13ae8cf70099 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:02.479044 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8e30b70-10cf-4d08-88bf-13ae8cf70099 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.479487 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8e30b70-10cf-4d08-88bf-13ae8cf70099 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:02.480252 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8e30b70-10cf-4d08-88bf-13ae8cf70099 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:02.480687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8e30b70-10cf-4d08-88bf-13ae8cf70099 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:03.285896 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c2739043-b993-42bd-9159-a2f278cad31a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:03.286517 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c2739043-b993-42bd-9159-a2f278cad31a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:03.294495 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c2739043-b993-42bd-9159-a2f278cad31a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:03.295067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c2739043-b993-42bd-9159-a2f278cad31a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:03.296077 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c2739043-b993-42bd-9159-a2f278cad31a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:03.296770 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c2739043-b993-42bd-9159-a2f278cad31a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:03.467280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c2739043-b993-42bd-9159-a2f278cad31a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:03.475981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c2739043-b993-42bd-9159-a2f278cad31a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.193344 Aug 02 09:09:03.476631 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 205/406] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:03 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:03.544544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e8e30b70-10cf-4d08-88bf-13ae8cf70099 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "POST /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.082969 Aug 02 09:09:03.545522 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 202/407] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:09:02 2022] POST /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments => generated 194 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:04.500540 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b76006d3-d961-4031-a2c6-be19c2b7e259 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:04.501037 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b76006d3-d961-4031-a2c6-be19c2b7e259 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:04.507804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b76006d3-d961-4031-a2c6-be19c2b7e259 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:04.508100 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b76006d3-d961-4031-a2c6-be19c2b7e259 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:04.508867 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b76006d3-d961-4031-a2c6-be19c2b7e259 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:04.509298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b76006d3-d961-4031-a2c6-be19c2b7e259 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:04.541329 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:04.652721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b76006d3-d961-4031-a2c6-be19c2b7e259 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:04.660362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b76006d3-d961-4031-a2c6-be19c2b7e259 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.167059 Aug 02 09:09:04.660931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 206/408] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:04 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:05.683659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-85f6974b-74a0-480f-9078-b651ba4d3b6b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:05.684469 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-85f6974b-74a0-480f-9078-b651ba4d3b6b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:05.691179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-85f6974b-74a0-480f-9078-b651ba4d3b6b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:05.691630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-85f6974b-74a0-480f-9078-b651ba4d3b6b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:05.692412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-85f6974b-74a0-480f-9078-b651ba4d3b6b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:05.692882 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-85f6974b-74a0-480f-9078-b651ba4d3b6b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:05.861844 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-85f6974b-74a0-480f-9078-b651ba4d3b6b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:05.874361 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-85f6974b-74a0-480f-9078-b651ba4d3b6b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.195601 Aug 02 09:09:05.875354 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 203/409] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:05 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:06.896862 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-622f6ab0-f55a-40f5-8b4f-4a85f7c39e7b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:06.897498 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-622f6ab0-f55a-40f5-8b4f-4a85f7c39e7b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:06.904162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-622f6ab0-f55a-40f5-8b4f-4a85f7c39e7b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:06.906647 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-622f6ab0-f55a-40f5-8b4f-4a85f7c39e7b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:06.906647 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-622f6ab0-f55a-40f5-8b4f-4a85f7c39e7b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:06.906647 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-622f6ab0-f55a-40f5-8b4f-4a85f7c39e7b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:07.056709 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-622f6ab0-f55a-40f5-8b4f-4a85f7c39e7b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:07.064928 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-622f6ab0-f55a-40f5-8b4f-4a85f7c39e7b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.171938 Aug 02 09:09:07.066020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 207/410] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:06 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:08.100931 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-94559e56-e96c-4b76-ac42-99fdff98e61e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:08.100931 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-94559e56-e96c-4b76-ac42-99fdff98e61e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:08.113104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-94559e56-e96c-4b76-ac42-99fdff98e61e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:08.113104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-94559e56-e96c-4b76-ac42-99fdff98e61e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:08.115087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-94559e56-e96c-4b76-ac42-99fdff98e61e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:08.115087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-94559e56-e96c-4b76-ac42-99fdff98e61e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:08.317971 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-94559e56-e96c-4b76-ac42-99fdff98e61e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:08.328404 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-94559e56-e96c-4b76-ac42-99fdff98e61e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.245740 Aug 02 09:09:08.330648 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 204/411] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:08 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:09.356926 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-457650c8-2b9e-4b76-9105-28ffefd1208b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:09.357665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-457650c8-2b9e-4b76-9105-28ffefd1208b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:09.364886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-457650c8-2b9e-4b76-9105-28ffefd1208b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:09.365440 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-457650c8-2b9e-4b76-9105-28ffefd1208b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:09.366227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-457650c8-2b9e-4b76-9105-28ffefd1208b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:09.366708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-457650c8-2b9e-4b76-9105-28ffefd1208b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:09.511792 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-457650c8-2b9e-4b76-9105-28ffefd1208b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:09.521579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-457650c8-2b9e-4b76-9105-28ffefd1208b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.169864 Aug 02 09:09:09.522218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 208/412] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:09 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:10.546932 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f037f520-f1ea-4219-a10c-760e6bb2f684 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:10.548082 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f037f520-f1ea-4219-a10c-760e6bb2f684 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:10.558612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f037f520-f1ea-4219-a10c-760e6bb2f684 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:10.559506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f037f520-f1ea-4219-a10c-760e6bb2f684 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:10.560549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f037f520-f1ea-4219-a10c-760e6bb2f684 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:10.561254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f037f520-f1ea-4219-a10c-760e6bb2f684 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:10.712858 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f037f520-f1ea-4219-a10c-760e6bb2f684 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:10.720967 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f037f520-f1ea-4219-a10c-760e6bb2f684 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.180303 Aug 02 09:09:10.721546 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 205/413] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:10 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:11.745920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5eafdb8e-0964-4842-9f62-5a6ade64f569 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:11.746609 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5eafdb8e-0964-4842-9f62-5a6ade64f569 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:11.753456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5eafdb8e-0964-4842-9f62-5a6ade64f569 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:11.754386 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5eafdb8e-0964-4842-9f62-5a6ade64f569 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:11.754726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5eafdb8e-0964-4842-9f62-5a6ade64f569 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:11.755156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5eafdb8e-0964-4842-9f62-5a6ade64f569 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:11.915821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5eafdb8e-0964-4842-9f62-5a6ade64f569 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:11.919836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:11.925716 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5eafdb8e-0964-4842-9f62-5a6ade64f569 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.183975 Aug 02 09:09:11.927882 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 209/414] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:11 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:12.950219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bcf1f553-3512-46a0-bf9b-42dcaf20100f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:12.950745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bcf1f553-3512-46a0-bf9b-42dcaf20100f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:12.958186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bcf1f553-3512-46a0-bf9b-42dcaf20100f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:12.959317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bcf1f553-3512-46a0-bf9b-42dcaf20100f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:12.960155 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bcf1f553-3512-46a0-bf9b-42dcaf20100f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:12.960589 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bcf1f553-3512-46a0-bf9b-42dcaf20100f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:13.101581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bcf1f553-3512-46a0-bf9b-42dcaf20100f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:13.109294 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bcf1f553-3512-46a0-bf9b-42dcaf20100f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.163241 Aug 02 09:09:13.109851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 206/415] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:12 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:14.131334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c5728af7-ff52-46f3-87f6-0f0273b4fee9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:14.131938 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c5728af7-ff52-46f3-87f6-0f0273b4fee9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:14.138676 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c5728af7-ff52-46f3-87f6-0f0273b4fee9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:14.139125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c5728af7-ff52-46f3-87f6-0f0273b4fee9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:14.140064 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c5728af7-ff52-46f3-87f6-0f0273b4fee9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:14.140326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c5728af7-ff52-46f3-87f6-0f0273b4fee9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:14.297471 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c5728af7-ff52-46f3-87f6-0f0273b4fee9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:14.306374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c5728af7-ff52-46f3-87f6-0f0273b4fee9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.178826 Aug 02 09:09:14.306958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 210/416] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:14 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:15.329143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a0171182-bc67-4949-8b42-484d0a71f740 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:15.330312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a0171182-bc67-4949-8b42-484d0a71f740 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:15.337409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a0171182-bc67-4949-8b42-484d0a71f740 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:15.337958 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a0171182-bc67-4949-8b42-484d0a71f740 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:15.338743 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a0171182-bc67-4949-8b42-484d0a71f740 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:15.339168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a0171182-bc67-4949-8b42-484d0a71f740 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:15.496401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a0171182-bc67-4949-8b42-484d0a71f740 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:15.510654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a0171182-bc67-4949-8b42-484d0a71f740 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.185220 Aug 02 09:09:15.512067 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 207/417] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:15 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:16.538571 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-29d474a9-2966-4259-a186-a8eae8644afb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:16.541701 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-29d474a9-2966-4259-a186-a8eae8644afb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:16.546725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-29d474a9-2966-4259-a186-a8eae8644afb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:16.547179 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-29d474a9-2966-4259-a186-a8eae8644afb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:16.548138 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-29d474a9-2966-4259-a186-a8eae8644afb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:16.548769 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-29d474a9-2966-4259-a186-a8eae8644afb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:16.723979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-29d474a9-2966-4259-a186-a8eae8644afb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:16.732822 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-29d474a9-2966-4259-a186-a8eae8644afb tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.200975 Aug 02 09:09:16.733390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 211/418] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:16 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:17.756307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b6516a71-93b5-4e43-a9e8-8f30c4d6506d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:17.757587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b6516a71-93b5-4e43-a9e8-8f30c4d6506d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:17.773414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b6516a71-93b5-4e43-a9e8-8f30c4d6506d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:17.774124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b6516a71-93b5-4e43-a9e8-8f30c4d6506d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:17.775204 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b6516a71-93b5-4e43-a9e8-8f30c4d6506d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:17.776270 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b6516a71-93b5-4e43-a9e8-8f30c4d6506d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:18.005452 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b6516a71-93b5-4e43-a9e8-8f30c4d6506d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:18.015095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b6516a71-93b5-4e43-a9e8-8f30c4d6506d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.263203 Aug 02 09:09:18.015847 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 208/419] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:17 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:19.038289 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d3acc555-bca3-4aee-997e-aa1db8098e38 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:19.038901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d3acc555-bca3-4aee-997e-aa1db8098e38 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:19.045451 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d3acc555-bca3-4aee-997e-aa1db8098e38 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:19.045876 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d3acc555-bca3-4aee-997e-aa1db8098e38 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:19.046687 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d3acc555-bca3-4aee-997e-aa1db8098e38 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:19.047112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d3acc555-bca3-4aee-997e-aa1db8098e38 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:19.225819 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d3acc555-bca3-4aee-997e-aa1db8098e38 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:19.234344 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d3acc555-bca3-4aee-997e-aa1db8098e38 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1500 microversion: 2.1 time: 0.199848 Aug 02 09:09:19.234931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 212/420] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:19 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1500 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:19.256964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1a95f90-fd8f-4bed-80c4-fce3774bb634"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:19.259816 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:19.262256 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=46 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:19.269128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:19.269570 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:19.270429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:19.270883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:19.301118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] HTTP exception thrown: Cannot 'attach_volume' instance 03b73e88-9298-4f0b-b36b-069907a1a076 while it is in vm_state rescued Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Request method failure captured: Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: POST /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076/os-volume_attachments HTTP/1.1 Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 74 Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkUtiZTGQAKR0dnal4vCTJhYWvzTPJv-sAIuyoSTn45EtNUdfqxAymXsvlQ2XliECiosiusjoT-xAJPEVdetmgxFh17XLW49kaAKo2J-oUceW7KA8uCZueHdpSeFK8W79HENaYFsQLGqtE4eO-1Lf0taojSxSbXWPVAggEdLBKn6t8 Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:09:19.305867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_259e864bb08645c79dfab23aa56d8822"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 7fd6b148658e4c2884a32f66326833b6 Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {"volumeAttachment": {"volumeId": "a1a95f90-fd8f-4bed-80c4-fce3774bb634"}} Aug 02 09:09:19.307842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Cannot 'attach_volume' instance 03b73e88-9298-4f0b-b36b-069907a1a076 while it is in vm_state rescued Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'server_id': '03b73e88-9298-4f0b-b36b-069907a1a076', 'body': {'volumeAttachment': {'volumeId': 'a1a95f90-fd8f-4bed-80c4-fce3774bb634'}}} Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 03b73e88-9298-4f0b-b36b-069907a1a076 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:09:19.309144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 03b73e88-9298-4f0b-b36b-069907a1a076 while it is in vm_state rescued Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:09:19.310960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:09:19.312960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:09:19.312960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:09:19.312960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 03b73e88-9298-4f0b-b36b-069907a1a076 while it is in vm_state rescued Aug 02 09:09:19.312960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:09:19.312960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Returning 409 to user: Cannot 'attach_volume' instance 03b73e88-9298-4f0b-b36b-069907a1a076 while it is in vm_state rescued {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:09:19.312960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cd16c42a-e708-4a83-9a1a-6b00a17c4fff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055313 Aug 02 09:09:19.312960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 209/421] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:09:19 2022] POST /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 02 09:09:19.339122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7b6aef5a-ca26-4880-b09c-7745f9215ad6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:19.339122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7b6aef5a-ca26-4880-b09c-7745f9215ad6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:19.339122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7b6aef5a-ca26-4880-b09c-7745f9215ad6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:19.339122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7b6aef5a-ca26-4880-b09c-7745f9215ad6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:19.339628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7b6aef5a-ca26-4880-b09c-7745f9215ad6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:19.339628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7b6aef5a-ca26-4880-b09c-7745f9215ad6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:19.715482 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7b6aef5a-ca26-4880-b09c-7745f9215ad6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076/action" status: 202 len: 0 microversion: 2.1 time: 0.399731 Aug 02 09:09:19.726546 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 213/422] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:09:19 2022] POST /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:09:19.732377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c9a72773-1798-44b9-b403-ca86b87563ea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:19.733177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c9a72773-1798-44b9-b403-ca86b87563ea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:19.741582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c9a72773-1798-44b9-b403-ca86b87563ea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:19.742061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c9a72773-1798-44b9-b403-ca86b87563ea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:19.743023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c9a72773-1798-44b9-b403-ca86b87563ea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:19.743454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c9a72773-1798-44b9-b403-ca86b87563ea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:19.894826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c9a72773-1798-44b9-b403-ca86b87563ea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:19.905615 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c9a72773-1798-44b9-b403-ca86b87563ea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.177090 Aug 02 09:09:19.906761 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 210/423] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:19 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:20.937096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f75d3f60-5855-485f-bf3f-d2b7de78aea0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:20.937464 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f75d3f60-5855-485f-bf3f-d2b7de78aea0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:20.939551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=48 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:20.945309 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f75d3f60-5855-485f-bf3f-d2b7de78aea0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:20.945767 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f75d3f60-5855-485f-bf3f-d2b7de78aea0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:20.946579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f75d3f60-5855-485f-bf3f-d2b7de78aea0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:20.947012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f75d3f60-5855-485f-bf3f-d2b7de78aea0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:21.348058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f75d3f60-5855-485f-bf3f-d2b7de78aea0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:21.359112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f75d3f60-5855-485f-bf3f-d2b7de78aea0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.428505 Aug 02 09:09:21.359902 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 214/424] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:20 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:21.392128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4f8489cc-641f-4c20-b494-29177ffddb36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:21.392703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4f8489cc-641f-4c20-b494-29177ffddb36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:21.404697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f8489cc-641f-4c20-b494-29177ffddb36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:21.405616 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f8489cc-641f-4c20-b494-29177ffddb36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:21.406683 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f8489cc-641f-4c20-b494-29177ffddb36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:21.406683 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f8489cc-641f-4c20-b494-29177ffddb36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:21.593219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4f8489cc-641f-4c20-b494-29177ffddb36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:21.608827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4f8489cc-641f-4c20-b494-29177ffddb36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1596 microversion: 2.1 time: 0.220362 Aug 02 09:09:21.622132 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 211/425] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:21 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1596 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:22.382613 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b33c9ea9-0a82-4fa1-a32c-00c4674bd964 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:22.383280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b33c9ea9-0a82-4fa1-a32c-00c4674bd964 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:22.390503 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b33c9ea9-0a82-4fa1-a32c-00c4674bd964 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:22.391059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b33c9ea9-0a82-4fa1-a32c-00c4674bd964 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:22.391729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b33c9ea9-0a82-4fa1-a32c-00c4674bd964 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:22.392165 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b33c9ea9-0a82-4fa1-a32c-00c4674bd964 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:22.556888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b33c9ea9-0a82-4fa1-a32c-00c4674bd964 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:22.564319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b33c9ea9-0a82-4fa1-a32c-00c4674bd964 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.186297 Aug 02 09:09:22.564886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 215/426] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:22 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:23.597866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d44e900f-83bc-4c0d-b33e-bc18e0cf3eb0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:23.601612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d44e900f-83bc-4c0d-b33e-bc18e0cf3eb0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:23.612754 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d44e900f-83bc-4c0d-b33e-bc18e0cf3eb0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:23.613530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d44e900f-83bc-4c0d-b33e-bc18e0cf3eb0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:23.615778 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d44e900f-83bc-4c0d-b33e-bc18e0cf3eb0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:23.616531 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d44e900f-83bc-4c0d-b33e-bc18e0cf3eb0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:23.945284 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d44e900f-83bc-4c0d-b33e-bc18e0cf3eb0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:23.954600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d44e900f-83bc-4c0d-b33e-bc18e0cf3eb0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.371045 Aug 02 09:09:23.955193 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 212/427] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:23 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:24.765529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-85131ad1-e69b-41c1-b810-8c48dfa6ee7b req-ba94c97f-07d0-482a-a67a-3fb393c5c293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9b683c-91dd-41ab-a9ee-45c9af6dc89b", "tag": "c42abcac-01a1-4142-811d-f1eb28ab8e79"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:24.775498 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-85131ad1-e69b-41c1-b810-8c48dfa6ee7b req-ba94c97f-07d0-482a-a67a-3fb393c5c293 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:24.775944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-85131ad1-e69b-41c1-b810-8c48dfa6ee7b req-ba94c97f-07d0-482a-a67a-3fb393c5c293 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:24.788070 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-85131ad1-e69b-41c1-b810-8c48dfa6ee7b req-ba94c97f-07d0-482a-a67a-3fb393c5c293 service nova] Creating event network-changed:c42abcac-01a1-4142-811d-f1eb28ab8e79 for instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b on hv-cinder-84713 Aug 02 09:09:24.793138 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-85131ad1-e69b-41c1-b810-8c48dfa6ee7b req-ba94c97f-07d0-482a-a67a-3fb393c5c293 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031246 Aug 02 09:09:24.793920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 216/428] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:24.977171 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c84af75d-7d1c-4c31-af5f-3936e8e2bd3e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:24.977788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c84af75d-7d1c-4c31-af5f-3936e8e2bd3e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:24.984708 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c84af75d-7d1c-4c31-af5f-3936e8e2bd3e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:24.985375 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c84af75d-7d1c-4c31-af5f-3936e8e2bd3e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:24.986207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c84af75d-7d1c-4c31-af5f-3936e8e2bd3e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:24.986646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c84af75d-7d1c-4c31-af5f-3936e8e2bd3e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:25.139225 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c84af75d-7d1c-4c31-af5f-3936e8e2bd3e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:25.147412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c84af75d-7d1c-4c31-af5f-3936e8e2bd3e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.174328 Aug 02 09:09:25.150290 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 213/429] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:24 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:26.169784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-87f9d451-a61b-46f5-a04f-ce49c2fcad34 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:26.170512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-87f9d451-a61b-46f5-a04f-ce49c2fcad34 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:26.177538 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-87f9d451-a61b-46f5-a04f-ce49c2fcad34 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:26.178020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-87f9d451-a61b-46f5-a04f-ce49c2fcad34 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:26.178797 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-87f9d451-a61b-46f5-a04f-ce49c2fcad34 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:26.179232 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-87f9d451-a61b-46f5-a04f-ce49c2fcad34 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:26.322697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-87f9d451-a61b-46f5-a04f-ce49c2fcad34 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:26.324902 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-87f9d451-a61b-46f5-a04f-ce49c2fcad34 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.159472 Aug 02 09:09:26.325468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 217/430] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:26 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:27.346649 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e501f7dc-09d4-4387-8b8a-f9c545e13937 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:27.351399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e501f7dc-09d4-4387-8b8a-f9c545e13937 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:27.354579 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e501f7dc-09d4-4387-8b8a-f9c545e13937 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:27.355028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e501f7dc-09d4-4387-8b8a-f9c545e13937 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:27.355789 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e501f7dc-09d4-4387-8b8a-f9c545e13937 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:27.356221 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e501f7dc-09d4-4387-8b8a-f9c545e13937 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:27.373972 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:27.454505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4a6c6474-6a30-489b-aa50-29e412e7596f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1906213831"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:27.455091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4a6c6474-6a30-489b-aa50-29e412e7596f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:27.462090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4a6c6474-6a30-489b-aa50-29e412e7596f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:27.462620 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4a6c6474-6a30-489b-aa50-29e412e7596f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:27.463576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4a6c6474-6a30-489b-aa50-29e412e7596f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:27.469308 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4a6c6474-6a30-489b-aa50-29e412e7596f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:27.497475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e501f7dc-09d4-4387-8b8a-f9c545e13937 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:27.505587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e501f7dc-09d4-4387-8b8a-f9c545e13937 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.162730 Aug 02 09:09:27.506262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 214/431] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:27 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:27.596235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.network.security_group_api [None req-4a6c6474-6a30-489b-aa50-29e412e7596f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Adding security group ea373968-ccf7-4f61-8096-cd8e08b613ed to port c42abcac-01a1-4142-811d-f1eb28ab8e79 Aug 02 09:09:28.079101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4a6c6474-6a30-489b-aa50-29e412e7596f tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "POST /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/action" status: 202 len: 0 microversion: 2.1 time: 0.628846 Aug 02 09:09:28.079708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 218/432] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:09:27 2022] POST /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:09:28.091164 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-704f0aa8-a59b-4096-9c13-0dd928d50704 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:28.091788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-704f0aa8-a59b-4096-9c13-0dd928d50704 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:28.092248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-13c00d19-2562-433d-ab94-6f8e6b237d5a req-f11e2486-af1a-4db8-bfe0-66e8a3fd4a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9b683c-91dd-41ab-a9ee-45c9af6dc89b", "tag": "c42abcac-01a1-4142-811d-f1eb28ab8e79"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:28.104507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-13c00d19-2562-433d-ab94-6f8e6b237d5a req-f11e2486-af1a-4db8-bfe0-66e8a3fd4a6c service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:28.105090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-13c00d19-2562-433d-ab94-6f8e6b237d5a req-f11e2486-af1a-4db8-bfe0-66e8a3fd4a6c service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:28.105564 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-704f0aa8-a59b-4096-9c13-0dd928d50704 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:28.106661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-704f0aa8-a59b-4096-9c13-0dd928d50704 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:28.107730 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-704f0aa8-a59b-4096-9c13-0dd928d50704 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:28.108291 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-704f0aa8-a59b-4096-9c13-0dd928d50704 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:28.122306 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-13c00d19-2562-433d-ab94-6f8e6b237d5a req-f11e2486-af1a-4db8-bfe0-66e8a3fd4a6c service nova] Creating event network-changed:c42abcac-01a1-4142-811d-f1eb28ab8e79 for instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b on hv-cinder-84713 Aug 02 09:09:28.128393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-13c00d19-2562-433d-ab94-6f8e6b237d5a req-f11e2486-af1a-4db8-bfe0-66e8a3fd4a6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040001 Aug 02 09:09:28.129572 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 219/433] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:28.288920 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-704f0aa8-a59b-4096-9c13-0dd928d50704 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:28.297432 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-704f0aa8-a59b-4096-9c13-0dd928d50704 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1643 microversion: 2.1 time: 0.211908 Aug 02 09:09:28.298071 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 215/434] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:28 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1643 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:28.534537 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-95d7d04a-3137-4db9-a82c-45bf26eefff5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:28.535246 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-95d7d04a-3137-4db9-a82c-45bf26eefff5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:28.541910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95d7d04a-3137-4db9-a82c-45bf26eefff5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:28.542372 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95d7d04a-3137-4db9-a82c-45bf26eefff5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:28.543156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95d7d04a-3137-4db9-a82c-45bf26eefff5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:28.543591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95d7d04a-3137-4db9-a82c-45bf26eefff5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:28.677353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-95d7d04a-3137-4db9-a82c-45bf26eefff5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:28.685567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-95d7d04a-3137-4db9-a82c-45bf26eefff5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.155101 Aug 02 09:09:28.686204 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 220/435] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:28 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:29.708133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0ca2d239-38e8-46b2-8d7b-794064a8dfa0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:29.709138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0ca2d239-38e8-46b2-8d7b-794064a8dfa0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:29.715488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0ca2d239-38e8-46b2-8d7b-794064a8dfa0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:29.715929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0ca2d239-38e8-46b2-8d7b-794064a8dfa0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:29.717118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0ca2d239-38e8-46b2-8d7b-794064a8dfa0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:29.717318 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0ca2d239-38e8-46b2-8d7b-794064a8dfa0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:29.871239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0ca2d239-38e8-46b2-8d7b-794064a8dfa0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:29.880957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0ca2d239-38e8-46b2-8d7b-794064a8dfa0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1508 microversion: 2.1 time: 0.176839 Aug 02 09:09:29.881551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 216/436] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:29 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:30.902315 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dbf61262-b240-4ae0-a053-41563d2af024 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:30.902966 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-dbf61262-b240-4ae0-a053-41563d2af024 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:30.909911 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dbf61262-b240-4ae0-a053-41563d2af024 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:30.915279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dbf61262-b240-4ae0-a053-41563d2af024 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:30.915279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dbf61262-b240-4ae0-a053-41563d2af024 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:30.915279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dbf61262-b240-4ae0-a053-41563d2af024 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:31.103302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-812046740", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:31.142122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dbf61262-b240-4ae0-a053-41563d2af024 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:31.152095 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dbf61262-b240-4ae0-a053-41563d2af024 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1514 microversion: 2.1 time: 0.253432 Aug 02 09:09:31.153585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 221/437] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:30 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:31.190449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] validate_networks() for None {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:09:31.422916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1480311928", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "networks": [{"uuid": "7c2a3b39-87f7-4d80-9d95-36c0e3075924"}]}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:31.494786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] validate_networks() for [('7c2a3b39-87f7-4d80-9d95-36c0e3075924', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:09:31.590625 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:09:31.591129 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:09:31.591672 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:09:31.592421 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:09:31.595889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:09:31.603827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:31.604553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:31.605587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:31.606046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:31.625463 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Getting quotas for project a622931a6e284ee1a512fcbfc61e1357. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:09:31.630128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Getting quotas for user 2e2b7380d83c4fcb857a54ae51b68ed0 and project a622931a6e284ee1a512fcbfc61e1357. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:09:31.644179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:09:31.646247 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:09:31.787780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a59ec776-ed42-46f5-b073-373681a7b1ad tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688482 Aug 02 09:09:31.798166 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 217/438] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:09:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:09:31.804550 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f30dd539-c337-41c3-8d26-74e8c5afa43c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:31.805781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f30dd539-c337-41c3-8d26-74e8c5afa43c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:31.889654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f30dd539-c337-41c3-8d26-74e8c5afa43c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:31.904320 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f30dd539-c337-41c3-8d26-74e8c5afa43c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1214 microversion: 2.1 time: 0.104661 Aug 02 09:09:31.905900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 218/439] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:31 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:32.006166 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:09:32.006952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:09:32.007390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:09:32.007805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:09:32.008316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:09:32.017868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:32.018346 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:32.019235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:32.020143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:32.038779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Getting quotas for project 3096d9a95111415d893c6fc82ce860c4. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:09:32.043257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Getting quotas for user d1381b81b5e14cfab800d6d3e8214f00 and project 3096d9a95111415d893c6fc82ce860c4. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:09:32.055811 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:09:32.058101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:09:32.181471 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f2f45cd4-3489-4651-b2a0-de8ba33ebeb2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763060 Aug 02 09:09:32.182158 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 222/440] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:09:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:09:32.194094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c7f7668d-8b59-4cf5-a471-487f3299c129 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:32.194996 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c7f7668d-8b59-4cf5-a471-487f3299c129 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:32.277160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c7f7668d-8b59-4cf5-a471-487f3299c129 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:32.284910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c7f7668d-8b59-4cf5-a471-487f3299c129 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1214 microversion: 2.1 time: 0.095627 Aug 02 09:09:32.285786 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 219/441] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:32 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:32.928711 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8e7f6560-36b9-4a73-929a-3785c09849f2 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:32.928969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8e7f6560-36b9-4a73-929a-3785c09849f2 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:32.993297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8e7f6560-36b9-4a73-929a-3785c09849f2 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:33.000897 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8e7f6560-36b9-4a73-929a-3785c09849f2 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1214 microversion: 2.1 time: 0.077563 Aug 02 09:09:33.001577 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 223/442] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:32 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:33.305823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f4d5954c-e92e-4155-a2d5-d2719a24de8d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:33.306475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f4d5954c-e92e-4155-a2d5-d2719a24de8d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:33.363525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f4d5954c-e92e-4155-a2d5-d2719a24de8d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:33.370381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f4d5954c-e92e-4155-a2d5-d2719a24de8d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1214 microversion: 2.1 time: 0.068605 Aug 02 09:09:33.370953 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 220/443] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:33 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:34.000955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7cc0ff17-b128-46dd-a620-667d87758921 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'create', calling method: .version_select at 0x7f0f2d9d0d30>, body: {"keypair": {"name": "tempest-keypair-1851297679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3DQvLAet6C9bHOjf/VxjCtlxYoXUFCacDzOzI0RaoCt0FoOQzz/rwLFIe6/zAm+mIUIplekfrqfN8rB3kVvUpZKrNzwh4u0eWsOjhXH6R77U4xaQG1uEH4MkFMjXj73A=="}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:34.018246 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-7cc0ff17-b128-46dd-a620-667d87758921 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Getting quotas for project 259e864bb08645c79dfab23aa56d8822. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:09:34.021727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-133dbcca-c840-4dc1-95f9-d4bf56181ae6 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:34.022230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-7cc0ff17-b128-46dd-a620-667d87758921 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Getting quotas for user 7fd6b148658e4c2884a32f66326833b6 and project 259e864bb08645c79dfab23aa56d8822. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:09:34.022357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-133dbcca-c840-4dc1-95f9-d4bf56181ae6 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:34.028491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-133dbcca-c840-4dc1-95f9-d4bf56181ae6 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:34.031678 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-133dbcca-c840-4dc1-95f9-d4bf56181ae6 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:34.031678 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-133dbcca-c840-4dc1-95f9-d4bf56181ae6 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:34.031678 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-133dbcca-c840-4dc1-95f9-d4bf56181ae6 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:34.095326 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-133dbcca-c840-4dc1-95f9-d4bf56181ae6 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:34.103672 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-133dbcca-c840-4dc1-95f9-d4bf56181ae6 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1210 microversion: 2.1 time: 0.085725 Aug 02 09:09:34.104217 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 221/444] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:34 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:34.129419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7cc0ff17-b128-46dd-a620-667d87758921 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131582 Aug 02 09:09:34.130144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 224/445] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:09:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:34.391514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fa631617-df0d-4a93-8961-390990d9d143 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:34.392108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fa631617-df0d-4a93-8961-390990d9d143 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:34.398825 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fa631617-df0d-4a93-8961-390990d9d143 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:34.399293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fa631617-df0d-4a93-8961-390990d9d143 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:34.400052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fa631617-df0d-4a93-8961-390990d9d143 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:34.400477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fa631617-df0d-4a93-8961-390990d9d143 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:34.466371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fa631617-df0d-4a93-8961-390990d9d143 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:34.474540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fa631617-df0d-4a93-8961-390990d9d143 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1266 microversion: 2.1 time: 0.086815 Aug 02 09:09:34.475101 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 222/446] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:34 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:35.130979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-328be3a8-9b99-4dc7-bce4-9d9f4b8d0290 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:35.132186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-328be3a8-9b99-4dc7-bce4-9d9f4b8d0290 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:35.151233 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-328be3a8-9b99-4dc7-bce4-9d9f4b8d0290 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:35.159438 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-328be3a8-9b99-4dc7-bce4-9d9f4b8d0290 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:35.160937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-328be3a8-9b99-4dc7-bce4-9d9f4b8d0290 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:35.166014 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-328be3a8-9b99-4dc7-bce4-9d9f4b8d0290 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:35.297723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-328be3a8-9b99-4dc7-bce4-9d9f4b8d0290 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:35.306538 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-328be3a8-9b99-4dc7-bce4-9d9f4b8d0290 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1274 microversion: 2.1 time: 0.183829 Aug 02 09:09:35.307524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 225/447] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:35 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:35.497116 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-746b9848-b80b-4c55-8150-9947e23352bd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:35.497667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-746b9848-b80b-4c55-8150-9947e23352bd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:35.505551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-746b9848-b80b-4c55-8150-9947e23352bd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:35.506387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-746b9848-b80b-4c55-8150-9947e23352bd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:35.507172 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-746b9848-b80b-4c55-8150-9947e23352bd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:35.507609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-746b9848-b80b-4c55-8150-9947e23352bd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:35.599702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-746b9848-b80b-4c55-8150-9947e23352bd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:35.612280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-746b9848-b80b-4c55-8150-9947e23352bd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1274 microversion: 2.1 time: 0.119119 Aug 02 09:09:35.613178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 223/448] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:35 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:36.331072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e34f687c-6fb3-4023-80d0-1d752ab4c060 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:36.342177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e34f687c-6fb3-4023-80d0-1d752ab4c060 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:36.360488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e34f687c-6fb3-4023-80d0-1d752ab4c060 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:36.360488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e34f687c-6fb3-4023-80d0-1d752ab4c060 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:36.360488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e34f687c-6fb3-4023-80d0-1d752ab4c060 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:36.360488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e34f687c-6fb3-4023-80d0-1d752ab4c060 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:36.439858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e34f687c-6fb3-4023-80d0-1d752ab4c060 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:36.448963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e34f687c-6fb3-4023-80d0-1d752ab4c060 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1272 microversion: 2.1 time: 0.123576 Aug 02 09:09:36.450185 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 226/449] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:36 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:36.636488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c8c1af98-ba87-4ae1-bef0-bf0bfc831a4b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:36.637219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c8c1af98-ba87-4ae1-bef0-bf0bfc831a4b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:36.650097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c8c1af98-ba87-4ae1-bef0-bf0bfc831a4b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:36.650692 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c8c1af98-ba87-4ae1-bef0-bf0bfc831a4b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:36.651494 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c8c1af98-ba87-4ae1-bef0-bf0bfc831a4b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:36.652137 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c8c1af98-ba87-4ae1-bef0-bf0bfc831a4b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:36.734280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c8c1af98-ba87-4ae1-bef0-bf0bfc831a4b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:36.744311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c8c1af98-ba87-4ae1-bef0-bf0bfc831a4b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1272 microversion: 2.1 time: 0.111540 Aug 02 09:09:36.745157 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 224/450] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:36 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:37.392848 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-292052804", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e629e91f-1fcf-4cf9-963e-2719f3797502"}], "security_groups": [{"name": "tempest-securitygroup--397913411"}], "key_name": "tempest-keypair-1851297679", "user_data": "}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:37.477156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5f691698-e191-4e32-b6b2-25950503a5f1 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:37.478207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5f691698-e191-4e32-b6b2-25950503a5f1 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:37.487405 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5f691698-e191-4e32-b6b2-25950503a5f1 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:37.488992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5f691698-e191-4e32-b6b2-25950503a5f1 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:37.490974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5f691698-e191-4e32-b6b2-25950503a5f1 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:37.491483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5f691698-e191-4e32-b6b2-25950503a5f1 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:37.539564 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] validate_networks() for [('e629e91f-1fcf-4cf9-963e-2719f3797502', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:09:37.700154 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5f691698-e191-4e32-b6b2-25950503a5f1 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:37.709219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5f691698-e191-4e32-b6b2-25950503a5f1 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.237105 Aug 02 09:09:37.711374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 225/451] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:37 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:37.768646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7aa4f912-73b0-4d9a-8a00-c667b441451c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:37.769810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7aa4f912-73b0-4d9a-8a00-c667b441451c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:37.776722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7aa4f912-73b0-4d9a-8a00-c667b441451c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:37.777295 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7aa4f912-73b0-4d9a-8a00-c667b441451c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:37.778223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7aa4f912-73b0-4d9a-8a00-c667b441451c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:37.778762 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7aa4f912-73b0-4d9a-8a00-c667b441451c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:38.028069 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7aa4f912-73b0-4d9a-8a00-c667b441451c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:38.040540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7aa4f912-73b0-4d9a-8a00-c667b441451c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.275970 Aug 02 09:09:38.041728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 226/452] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:37 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:38.182990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:09:38.184057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:09:38.184633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:09:38.185663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:09:38.186399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:09:38.199963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:38.199963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:38.200378 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:38.200813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:38.219739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Getting quotas for project 259e864bb08645c79dfab23aa56d8822. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:09:38.224573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Getting quotas for user 7fd6b148658e4c2884a32f66326833b6 and project 259e864bb08645c79dfab23aa56d8822. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:09:38.231894 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-af9d8454-4f81-4928-a788-37371455dcc3 req-c3a5c411-bd3d-4ae7-a4b0-52815701c4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4a6d33-3375-4a1c-971f-e531182ecea2", "tag": "bb49da6e-4d20-4834-977a-8a84e59e7acf"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:38.236263 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:09:38.239415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:09:38.252273 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-af9d8454-4f81-4928-a788-37371455dcc3 req-c3a5c411-bd3d-4ae7-a4b0-52815701c4a1 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:38.253664 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-af9d8454-4f81-4928-a788-37371455dcc3 req-c3a5c411-bd3d-4ae7-a4b0-52815701c4a1 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:38.268066 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-af9d8454-4f81-4928-a788-37371455dcc3 req-c3a5c411-bd3d-4ae7-a4b0-52815701c4a1 service nova] Creating event network-changed:bb49da6e-4d20-4834-977a-8a84e59e7acf for instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 on hv-cinder-84713 Aug 02 09:09:38.275177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-af9d8454-4f81-4928-a788-37371455dcc3 req-c3a5c411-bd3d-4ae7-a4b0-52815701c4a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058513 Aug 02 09:09:38.276409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 227/453] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:38.336652 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-c90a6cbc-eb28-4f6c-9ab3-dcda1dd990ee req-21d42dd1-0b93-4582-af5e-4c23559fa9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c7098f-f885-4587-a267-8d907a773d3b", "tag": "a79927d7-7078-4f31-a33d-f99427f2acff"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:38.346429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-c90a6cbc-eb28-4f6c-9ab3-dcda1dd990ee req-21d42dd1-0b93-4582-af5e-4c23559fa9d8 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:38.347145 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-c90a6cbc-eb28-4f6c-9ab3-dcda1dd990ee req-21d42dd1-0b93-4582-af5e-4c23559fa9d8 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:38.358288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-c90a6cbc-eb28-4f6c-9ab3-dcda1dd990ee req-21d42dd1-0b93-4582-af5e-4c23559fa9d8 service nova] Creating event network-changed:a79927d7-7078-4f31-a33d-f99427f2acff for instance 46c7098f-f885-4587-a267-8d907a773d3b on hv-cinder-84713 Aug 02 09:09:38.363453 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-c90a6cbc-eb28-4f6c-9ab3-dcda1dd990ee req-21d42dd1-0b93-4582-af5e-4c23559fa9d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030624 Aug 02 09:09:38.364209 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 228/454] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:38.378781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-abf6e6c4-fc32-4385-be2f-78e96a43dff8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.990991 Aug 02 09:09:38.379784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 227/455] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:09:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:09:38.398216 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-698a163d-501e-40b2-8a70-2878e0a872e0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:38.398906 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-698a163d-501e-40b2-8a70-2878e0a872e0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:38.504748 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-698a163d-501e-40b2-8a70-2878e0a872e0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:38.511877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-698a163d-501e-40b2-8a70-2878e0a872e0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1245 microversion: 2.1 time: 0.123755 Aug 02 09:09:38.512462 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 229/456] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:38 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:38.722217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fa401ff7-d0c2-4330-a94b-ad9e2a6cb894 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ca83626-7431-4bce-92e8-fae85a8ac536", "device": "/dev/sdb"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:38.730917 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-90b0c9d4-0ae4-4336-83be-f5f4674ac187 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:38.731639 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-90b0c9d4-0ae4-4336-83be-f5f4674ac187 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:38.731752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fa401ff7-d0c2-4330-a94b-ad9e2a6cb894 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:38.739376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-90b0c9d4-0ae4-4336-83be-f5f4674ac187 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:38.739555 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa401ff7-d0c2-4330-a94b-ad9e2a6cb894 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:38.744046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-90b0c9d4-0ae4-4336-83be-f5f4674ac187 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:38.744046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-90b0c9d4-0ae4-4336-83be-f5f4674ac187 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:38.744046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-90b0c9d4-0ae4-4336-83be-f5f4674ac187 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:38.744282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa401ff7-d0c2-4330-a94b-ad9e2a6cb894 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:38.744282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa401ff7-d0c2-4330-a94b-ad9e2a6cb894 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:38.744743 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa401ff7-d0c2-4330-a94b-ad9e2a6cb894 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:39.030949 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-90b0c9d4-0ae4-4336-83be-f5f4674ac187 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:39.042708 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-90b0c9d4-0ae4-4336-83be-f5f4674ac187 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.315587 Aug 02 09:09:39.043440 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 230/457] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:38 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:39.074031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e4330650-9f71-48ae-ace8-0b7c331e1711 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:39.074874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e4330650-9f71-48ae-ace8-0b7c331e1711 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:39.084279 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4330650-9f71-48ae-ace8-0b7c331e1711 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:39.090174 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4330650-9f71-48ae-ace8-0b7c331e1711 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:39.090174 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4330650-9f71-48ae-ace8-0b7c331e1711 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:39.090174 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4330650-9f71-48ae-ace8-0b7c331e1711 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:39.354246 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e4330650-9f71-48ae-ace8-0b7c331e1711 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:39.368908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e4330650-9f71-48ae-ace8-0b7c331e1711 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.308546 Aug 02 09:09:39.372025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 231/458] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:39 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:39.533939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-12cfe8a7-88c2-4aeb-95eb-07d81dc620ed tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:39.538827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-12cfe8a7-88c2-4aeb-95eb-07d81dc620ed tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:39.540866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12cfe8a7-88c2-4aeb-95eb-07d81dc620ed tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:39.541317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12cfe8a7-88c2-4aeb-95eb-07d81dc620ed tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:39.542114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12cfe8a7-88c2-4aeb-95eb-07d81dc620ed tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:39.542549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12cfe8a7-88c2-4aeb-95eb-07d81dc620ed tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:39.613256 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-12cfe8a7-88c2-4aeb-95eb-07d81dc620ed tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:39.617048 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-12cfe8a7-88c2-4aeb-95eb-07d81dc620ed tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1249 microversion: 2.1 time: 0.088646 Aug 02 09:09:39.617618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 232/459] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:39 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:39.775016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fa401ff7-d0c2-4330-a94b-ad9e2a6cb894 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "POST /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056459 Aug 02 09:09:39.775624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 228/460] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:09:38 2022] POST /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:40.063871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-21e1cc8a-96a5-4c27-b185-bb7fb25bf008 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:40.064512 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-21e1cc8a-96a5-4c27-b185-bb7fb25bf008 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:40.072450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-21e1cc8a-96a5-4c27-b185-bb7fb25bf008 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:40.072898 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-21e1cc8a-96a5-4c27-b185-bb7fb25bf008 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:40.073704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-21e1cc8a-96a5-4c27-b185-bb7fb25bf008 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:40.074161 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-21e1cc8a-96a5-4c27-b185-bb7fb25bf008 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:40.229968 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-21e1cc8a-96a5-4c27-b185-bb7fb25bf008 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:40.238192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-21e1cc8a-96a5-4c27-b185-bb7fb25bf008 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.177682 Aug 02 09:09:40.238767 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 233/461] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:40 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:40.391449 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a6b7704e-440b-469a-918c-702eaceaaed4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:40.392136 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a6b7704e-440b-469a-918c-702eaceaaed4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:40.398495 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a6b7704e-440b-469a-918c-702eaceaaed4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:40.398942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a6b7704e-440b-469a-918c-702eaceaaed4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:40.399715 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a6b7704e-440b-469a-918c-702eaceaaed4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:40.400151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a6b7704e-440b-469a-918c-702eaceaaed4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:40.404189 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:40.529646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a6b7704e-440b-469a-918c-702eaceaaed4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:40.538390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a6b7704e-440b-469a-918c-702eaceaaed4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.151569 Aug 02 09:09:40.540743 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 229/462] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:40 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:40.638478 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-943859da-f555-4dfb-8b55-60948734a5ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:40.639092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-943859da-f555-4dfb-8b55-60948734a5ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:40.645086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-943859da-f555-4dfb-8b55-60948734a5ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:40.645637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-943859da-f555-4dfb-8b55-60948734a5ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:40.646527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-943859da-f555-4dfb-8b55-60948734a5ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:40.646988 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-943859da-f555-4dfb-8b55-60948734a5ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:40.709833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-943859da-f555-4dfb-8b55-60948734a5ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:40.718187 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-943859da-f555-4dfb-8b55-60948734a5ef tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1249 microversion: 2.1 time: 0.083530 Aug 02 09:09:40.718771 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 234/463] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:40 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:41.258694 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5a7d72ce-a078-4c13-80b7-30afa99d2d49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:41.259322 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5a7d72ce-a078-4c13-80b7-30afa99d2d49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:41.265748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5a7d72ce-a078-4c13-80b7-30afa99d2d49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:41.266218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5a7d72ce-a078-4c13-80b7-30afa99d2d49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:41.266973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5a7d72ce-a078-4c13-80b7-30afa99d2d49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:41.267400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5a7d72ce-a078-4c13-80b7-30afa99d2d49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:41.411318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5a7d72ce-a078-4c13-80b7-30afa99d2d49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:41.419189 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5a7d72ce-a078-4c13-80b7-30afa99d2d49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.164674 Aug 02 09:09:41.419774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 230/464] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:41 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:41.560457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-03f05a9d-b87c-40c1-bb45-236c747fb850 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:41.561043 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-03f05a9d-b87c-40c1-bb45-236c747fb850 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:41.568277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-03f05a9d-b87c-40c1-bb45-236c747fb850 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:41.568722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-03f05a9d-b87c-40c1-bb45-236c747fb850 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:41.569488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-03f05a9d-b87c-40c1-bb45-236c747fb850 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:41.569961 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-03f05a9d-b87c-40c1-bb45-236c747fb850 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:41.614422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:41.702327 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-03f05a9d-b87c-40c1-bb45-236c747fb850 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:41.709753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-03f05a9d-b87c-40c1-bb45-236c747fb850 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.153225 Aug 02 09:09:41.710355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 235/465] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:41 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:41.739920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8cecaea7-2a03-4327-9d95-09f3b0efb3ff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:41.740552 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8cecaea7-2a03-4327-9d95-09f3b0efb3ff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:41.752025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8cecaea7-2a03-4327-9d95-09f3b0efb3ff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:41.752025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8cecaea7-2a03-4327-9d95-09f3b0efb3ff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:41.752025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8cecaea7-2a03-4327-9d95-09f3b0efb3ff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:41.752025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8cecaea7-2a03-4327-9d95-09f3b0efb3ff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:41.816282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8cecaea7-2a03-4327-9d95-09f3b0efb3ff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:41.823844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8cecaea7-2a03-4327-9d95-09f3b0efb3ff tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1249 microversion: 2.1 time: 0.088324 Aug 02 09:09:41.825569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 231/466] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:41 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:42.440898 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5a3048df-6060-4131-a202-6ceb36fbd397 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:42.441500 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5a3048df-6060-4131-a202-6ceb36fbd397 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:42.448006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5a3048df-6060-4131-a202-6ceb36fbd397 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:42.448443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5a3048df-6060-4131-a202-6ceb36fbd397 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:42.449203 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5a3048df-6060-4131-a202-6ceb36fbd397 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:42.449629 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5a3048df-6060-4131-a202-6ceb36fbd397 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:42.595453 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5a3048df-6060-4131-a202-6ceb36fbd397 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:42.603911 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5a3048df-6060-4131-a202-6ceb36fbd397 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.167006 Aug 02 09:09:42.604489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 236/467] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:42 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:42.730805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2827752b-84f7-427a-bcb3-96d7903fd1b7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:42.731481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2827752b-84f7-427a-bcb3-96d7903fd1b7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:42.739057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2827752b-84f7-427a-bcb3-96d7903fd1b7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:42.739717 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2827752b-84f7-427a-bcb3-96d7903fd1b7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:42.740366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2827752b-84f7-427a-bcb3-96d7903fd1b7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:42.740795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2827752b-84f7-427a-bcb3-96d7903fd1b7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:42.848430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-de348eb9-d8ad-4609-b8f8-5152ca7e385b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:42.849688 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-de348eb9-d8ad-4609-b8f8-5152ca7e385b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:42.860391 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de348eb9-d8ad-4609-b8f8-5152ca7e385b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:42.861447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de348eb9-d8ad-4609-b8f8-5152ca7e385b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:42.862818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de348eb9-d8ad-4609-b8f8-5152ca7e385b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:42.864302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de348eb9-d8ad-4609-b8f8-5152ca7e385b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:42.871878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:42.888633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2827752b-84f7-427a-bcb3-96d7903fd1b7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:42.897112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2827752b-84f7-427a-bcb3-96d7903fd1b7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.170255 Aug 02 09:09:42.901932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 232/468] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:42 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:42.948633 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-de348eb9-d8ad-4609-b8f8-5152ca7e385b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:42.957787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-de348eb9-d8ad-4609-b8f8-5152ca7e385b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1249 microversion: 2.1 time: 0.116556 Aug 02 09:09:42.958749 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 237/469] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:42 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:43.625355 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-91b2f327-2fe7-4aec-a1e8-adaf6ce7036e tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:43.625996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-91b2f327-2fe7-4aec-a1e8-adaf6ce7036e tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:43.632874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-91b2f327-2fe7-4aec-a1e8-adaf6ce7036e tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:43.633324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-91b2f327-2fe7-4aec-a1e8-adaf6ce7036e tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:43.634155 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-91b2f327-2fe7-4aec-a1e8-adaf6ce7036e tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:43.634591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-91b2f327-2fe7-4aec-a1e8-adaf6ce7036e tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:43.779002 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-91b2f327-2fe7-4aec-a1e8-adaf6ce7036e tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:43.786783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-91b2f327-2fe7-4aec-a1e8-adaf6ce7036e tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.165329 Aug 02 09:09:43.787369 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 233/470] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:43 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:43.919348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-065b1660-e2aa-465a-a3ff-83eb606cfdfb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:43.920023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-065b1660-e2aa-465a-a3ff-83eb606cfdfb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:43.927408 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-065b1660-e2aa-465a-a3ff-83eb606cfdfb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:43.927851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-065b1660-e2aa-465a-a3ff-83eb606cfdfb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:43.928637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-065b1660-e2aa-465a-a3ff-83eb606cfdfb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:43.929060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-065b1660-e2aa-465a-a3ff-83eb606cfdfb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:43.980650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-bfde0a01-22d3-4863-ae2e-bb0fef1ad583 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:43.981672 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-bfde0a01-22d3-4863-ae2e-bb0fef1ad583 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:43.992170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bfde0a01-22d3-4863-ae2e-bb0fef1ad583 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:43.992925 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bfde0a01-22d3-4863-ae2e-bb0fef1ad583 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:43.994387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bfde0a01-22d3-4863-ae2e-bb0fef1ad583 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:43.995119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bfde0a01-22d3-4863-ae2e-bb0fef1ad583 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:44.079055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bfde0a01-22d3-4863-ae2e-bb0fef1ad583 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:44.080814 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-065b1660-e2aa-465a-a3ff-83eb606cfdfb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:44.086605 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-bfde0a01-22d3-4863-ae2e-bb0fef1ad583 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1249 microversion: 2.1 time: 0.111859 Aug 02 09:09:44.089248 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-065b1660-e2aa-465a-a3ff-83eb606cfdfb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.173789 Aug 02 09:09:44.089824 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 238/471] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:43 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:44.098290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 234/472] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:43 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1249 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:44.808277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e41d2acc-5073-4c49-a3c5-f0053e2fc808 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:44.809075 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e41d2acc-5073-4c49-a3c5-f0053e2fc808 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:44.816811 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e41d2acc-5073-4c49-a3c5-f0053e2fc808 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:44.817355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e41d2acc-5073-4c49-a3c5-f0053e2fc808 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:44.818249 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e41d2acc-5073-4c49-a3c5-f0053e2fc808 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:44.818780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e41d2acc-5073-4c49-a3c5-f0053e2fc808 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:44.978942 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e41d2acc-5073-4c49-a3c5-f0053e2fc808 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:44.987336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e41d2acc-5073-4c49-a3c5-f0053e2fc808 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.182943 Aug 02 09:09:44.988807 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 239/473] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:44 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:45.110422 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a422ac6f-6142-4839-bc13-cb2d1e825067 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:45.111683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a422ac6f-6142-4839-bc13-cb2d1e825067 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:45.115439 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-56c0289a-3c8d-4b97-badd-69b9c99a8c1c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:45.116035 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-56c0289a-3c8d-4b97-badd-69b9c99a8c1c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:45.120327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a422ac6f-6142-4839-bc13-cb2d1e825067 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:45.121227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a422ac6f-6142-4839-bc13-cb2d1e825067 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:45.122598 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a422ac6f-6142-4839-bc13-cb2d1e825067 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:45.123419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a422ac6f-6142-4839-bc13-cb2d1e825067 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:45.126224 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-56c0289a-3c8d-4b97-badd-69b9c99a8c1c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:45.126839 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-56c0289a-3c8d-4b97-badd-69b9c99a8c1c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:45.128886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-56c0289a-3c8d-4b97-badd-69b9c99a8c1c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:45.130123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-56c0289a-3c8d-4b97-badd-69b9c99a8c1c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:45.218562 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a422ac6f-6142-4839-bc13-cb2d1e825067 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:45.226389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a422ac6f-6142-4839-bc13-cb2d1e825067 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1249 microversion: 2.1 time: 0.120782 Aug 02 09:09:45.226970 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 235/474] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:45 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1249 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:45.317770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-56c0289a-3c8d-4b97-badd-69b9c99a8c1c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:45.329418 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-56c0289a-3c8d-4b97-badd-69b9c99a8c1c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.221476 Aug 02 09:09:45.330034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 240/475] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:45 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:46.009317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3ba3f9b9-33d9-4441-85b9-d2e8d731ba98 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:46.009936 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3ba3f9b9-33d9-4441-85b9-d2e8d731ba98 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:46.016210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ba3f9b9-33d9-4441-85b9-d2e8d731ba98 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:46.016652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ba3f9b9-33d9-4441-85b9-d2e8d731ba98 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:46.017401 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ba3f9b9-33d9-4441-85b9-d2e8d731ba98 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:46.017826 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ba3f9b9-33d9-4441-85b9-d2e8d731ba98 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:46.155846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3ba3f9b9-33d9-4441-85b9-d2e8d731ba98 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:46.167155 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3ba3f9b9-33d9-4441-85b9-d2e8d731ba98 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.161754 Aug 02 09:09:46.167732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 236/476] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:46 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:46.252955 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4eec5a46-fe6d-4f0f-9084-d181ff965dcd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:46.254355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4eec5a46-fe6d-4f0f-9084-d181ff965dcd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:46.262363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4eec5a46-fe6d-4f0f-9084-d181ff965dcd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:46.262822 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4eec5a46-fe6d-4f0f-9084-d181ff965dcd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:46.263601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4eec5a46-fe6d-4f0f-9084-d181ff965dcd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:46.264065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4eec5a46-fe6d-4f0f-9084-d181ff965dcd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:46.333306 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4eec5a46-fe6d-4f0f-9084-d181ff965dcd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:46.341684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4eec5a46-fe6d-4f0f-9084-d181ff965dcd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1297 microversion: 2.1 time: 0.096135 Aug 02 09:09:46.345312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 241/477] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:46 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:46.352427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e499b147-c95e-4805-9bf0-2565e21b9759 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:46.353153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e499b147-c95e-4805-9bf0-2565e21b9759 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:46.359466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e499b147-c95e-4805-9bf0-2565e21b9759 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:46.359985 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e499b147-c95e-4805-9bf0-2565e21b9759 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:46.360823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e499b147-c95e-4805-9bf0-2565e21b9759 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:46.361319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e499b147-c95e-4805-9bf0-2565e21b9759 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:46.509420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e499b147-c95e-4805-9bf0-2565e21b9759 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:46.517846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e499b147-c95e-4805-9bf0-2565e21b9759 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.170138 Aug 02 09:09:46.518374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 237/478] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:46 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:47.195266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-186c0081-0a5a-425a-b5c1-e6778aa41ffc tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:47.196934 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-186c0081-0a5a-425a-b5c1-e6778aa41ffc tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:47.208126 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-186c0081-0a5a-425a-b5c1-e6778aa41ffc tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.209491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-186c0081-0a5a-425a-b5c1-e6778aa41ffc tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.210336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-186c0081-0a5a-425a-b5c1-e6778aa41ffc tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.210957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-186c0081-0a5a-425a-b5c1-e6778aa41ffc tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.245786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-f2cf7a02-5ca6-4ba3-81bd-71448acdc47a req-5fd53e5f-3060-4ea7-956e-fce993e704df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c7098f-f885-4587-a267-8d907a773d3b", "name": "network-vif-plugged", "status": "completed", "tag": "a79927d7-7078-4f31-a33d-f99427f2acff"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:47.276049 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-f2cf7a02-5ca6-4ba3-81bd-71448acdc47a req-5fd53e5f-3060-4ea7-956e-fce993e704df service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.279293 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-f2cf7a02-5ca6-4ba3-81bd-71448acdc47a req-5fd53e5f-3060-4ea7-956e-fce993e704df service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.300929 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-f2cf7a02-5ca6-4ba3-81bd-71448acdc47a req-5fd53e5f-3060-4ea7-956e-fce993e704df service nova] Creating event network-vif-plugged:a79927d7-7078-4f31-a33d-f99427f2acff for instance 46c7098f-f885-4587-a267-8d907a773d3b on hv-cinder-84713 Aug 02 09:09:47.311117 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-f2cf7a02-5ca6-4ba3-81bd-71448acdc47a req-5fd53e5f-3060-4ea7-956e-fce993e704df service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064777 Aug 02 09:09:47.311117 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 238/479] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:47.368879 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-27d5bd1b-64c1-494c-82ce-0d2467b338a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:47.369727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-27d5bd1b-64c1-494c-82ce-0d2467b338a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:47.376339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-27d5bd1b-64c1-494c-82ce-0d2467b338a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.379937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-27d5bd1b-64c1-494c-82ce-0d2467b338a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.379937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-27d5bd1b-64c1-494c-82ce-0d2467b338a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.379937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-27d5bd1b-64c1-494c-82ce-0d2467b338a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.463563 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-27d5bd1b-64c1-494c-82ce-0d2467b338a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:47.473520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-27d5bd1b-64c1-494c-82ce-0d2467b338a5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1303 microversion: 2.1 time: 0.108954 Aug 02 09:09:47.500501 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 239/480] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:47 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:47.525491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-186c0081-0a5a-425a-b5c1-e6778aa41ffc tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:47.533507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-186c0081-0a5a-425a-b5c1-e6778aa41ffc tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.342361 Aug 02 09:09:47.534596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 242/481] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:47 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:47.541568 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6267ce3a-b53b-46df-aff8-005a74494fdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:47.542399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6267ce3a-b53b-46df-aff8-005a74494fdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:47.548512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6267ce3a-b53b-46df-aff8-005a74494fdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.549211 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6267ce3a-b53b-46df-aff8-005a74494fdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.550317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6267ce3a-b53b-46df-aff8-005a74494fdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:47.550641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6267ce3a-b53b-46df-aff8-005a74494fdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:47.694444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6267ce3a-b53b-46df-aff8-005a74494fdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:47.703326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6267ce3a-b53b-46df-aff8-005a74494fdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.164770 Aug 02 09:09:47.703326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 240/482] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:47 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:48.258289 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:09:48.258572 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:09:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:09:48.510098 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a45182da-4c9f-4b4b-b03b-7eec6b115a8e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:48.510882 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a45182da-4c9f-4b4b-b03b-7eec6b115a8e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:48.513338 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=14 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:48.519630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a45182da-4c9f-4b4b-b03b-7eec6b115a8e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.520081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a45182da-4c9f-4b4b-b03b-7eec6b115a8e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.520846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a45182da-4c9f-4b4b-b03b-7eec6b115a8e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.521276 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a45182da-4c9f-4b4b-b03b-7eec6b115a8e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.555292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e4560903-e603-450e-91a9-78510057226b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:48.555997 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e4560903-e603-450e-91a9-78510057226b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:48.557917 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=4 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:48.558624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=18 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:48.564126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4560903-e603-450e-91a9-78510057226b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.564575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4560903-e603-450e-91a9-78510057226b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.565340 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4560903-e603-450e-91a9-78510057226b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.566356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4560903-e603-450e-91a9-78510057226b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.691424 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a45182da-4c9f-4b4b-b03b-7eec6b115a8e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:48.700326 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a45182da-4c9f-4b4b-b03b-7eec6b115a8e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.194514 Aug 02 09:09:48.701160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 243/483] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:48 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:48.722952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e4560903-e603-450e-91a9-78510057226b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:48.727361 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b75156cc-a397-4e71-99ac-c28a6a58aa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:48.728153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b75156cc-a397-4e71-99ac-c28a6a58aa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:48.732985 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e4560903-e603-450e-91a9-78510057226b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.181282 Aug 02 09:09:48.734749 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b75156cc-a397-4e71-99ac-c28a6a58aa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.735200 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b75156cc-a397-4e71-99ac-c28a6a58aa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.735965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b75156cc-a397-4e71-99ac-c28a6a58aa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.736397 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b75156cc-a397-4e71-99ac-c28a6a58aa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.741339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 241/484] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:48 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:48.759733 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-039a9ac9-0e26-4b1a-815b-a96458928c94 req-5849e954-7ba3-4e6c-9985-6b680b010b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93fca05-bed7-45c7-93fb-47a31cdf58f6", "tag": "c69e6c6c-a629-4816-a638-07c69b3b85b0"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:48.771716 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-039a9ac9-0e26-4b1a-815b-a96458928c94 req-5849e954-7ba3-4e6c-9985-6b680b010b88 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:48.772557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-039a9ac9-0e26-4b1a-815b-a96458928c94 req-5849e954-7ba3-4e6c-9985-6b680b010b88 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:48.785360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-039a9ac9-0e26-4b1a-815b-a96458928c94 req-5849e954-7ba3-4e6c-9985-6b680b010b88 service nova] Creating event network-changed:c69e6c6c-a629-4816-a638-07c69b3b85b0 for instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 on hv-cinder-84713 Aug 02 09:09:48.790310 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-039a9ac9-0e26-4b1a-815b-a96458928c94 req-5849e954-7ba3-4e6c-9985-6b680b010b88 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034504 Aug 02 09:09:48.790897 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 242/485] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:48.903883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b75156cc-a397-4e71-99ac-c28a6a58aa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:48.911446 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b75156cc-a397-4e71-99ac-c28a6a58aa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.187886 Aug 02 09:09:48.912014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 244/486] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:48 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:49.722669 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5ae0c744-0972-42f3-9348-0fbcc5a5043f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:49.723372 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5ae0c744-0972-42f3-9348-0fbcc5a5043f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:49.726102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:49.731597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ae0c744-0972-42f3-9348-0fbcc5a5043f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.732054 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ae0c744-0972-42f3-9348-0fbcc5a5043f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:49.732833 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ae0c744-0972-42f3-9348-0fbcc5a5043f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.738432 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-baf3c2eb-fca7-44bb-bb2d-b5404fa008b5 req-03114151-0d3e-49d1-98b4-be357bb0bc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4a6d33-3375-4a1c-971f-e531182ecea2", "name": "network-vif-plugged", "status": "completed", "tag": "bb49da6e-4d20-4834-977a-8a84e59e7acf"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:49.744136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:49.745516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ae0c744-0972-42f3-9348-0fbcc5a5043f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:49.751673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-baf3c2eb-fca7-44bb-bb2d-b5404fa008b5 req-03114151-0d3e-49d1-98b4-be357bb0bc35 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.752128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-baf3c2eb-fca7-44bb-bb2d-b5404fa008b5 req-03114151-0d3e-49d1-98b4-be357bb0bc35 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:49.766529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-baf3c2eb-fca7-44bb-bb2d-b5404fa008b5 req-03114151-0d3e-49d1-98b4-be357bb0bc35 service nova] Creating event network-vif-plugged:bb49da6e-4d20-4834-977a-8a84e59e7acf for instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 on hv-cinder-84713 Aug 02 09:09:49.773183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-baf3c2eb-fca7-44bb-bb2d-b5404fa008b5 req-03114151-0d3e-49d1-98b4-be357bb0bc35 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038201 Aug 02 09:09:49.774245 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 245/487] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:49.782536 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-29c7a960-9d57-4521-acb9-03d07c41a12a tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:49.783470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-29c7a960-9d57-4521-acb9-03d07c41a12a tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:49.791745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29c7a960-9d57-4521-acb9-03d07c41a12a tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.792202 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29c7a960-9d57-4521-acb9-03d07c41a12a tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:49.792984 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29c7a960-9d57-4521-acb9-03d07c41a12a tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.793420 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29c7a960-9d57-4521-acb9-03d07c41a12a tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:49.921710 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5ae0c744-0972-42f3-9348-0fbcc5a5043f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:49.933963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5ae0c744-0972-42f3-9348-0fbcc5a5043f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.216707 Aug 02 09:09:49.947661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 243/488] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:49 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:49.947661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d4cc57d0-b727-43c7-9e3d-6544c23bc267 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:49.947661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d4cc57d0-b727-43c7-9e3d-6544c23bc267 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:49.948582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d4cc57d0-b727-43c7-9e3d-6544c23bc267 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.948582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d4cc57d0-b727-43c7-9e3d-6544c23bc267 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:49.949264 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d4cc57d0-b727-43c7-9e3d-6544c23bc267 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:49.949864 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d4cc57d0-b727-43c7-9e3d-6544c23bc267 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:49.976472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-29c7a960-9d57-4521-acb9-03d07c41a12a tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:49.990102 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-29c7a960-9d57-4521-acb9-03d07c41a12a tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1314 microversion: 2.1 time: 0.212064 Aug 02 09:09:49.990753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 246/489] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:49 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:50.119591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d4cc57d0-b727-43c7-9e3d-6544c23bc267 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:50.127250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d4cc57d0-b727-43c7-9e3d-6544c23bc267 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.190571 Aug 02 09:09:50.128339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 244/490] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:49 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:50.963187 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2ddfe639-29e9-450a-955e-b3abb96ee281 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:50.964339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2ddfe639-29e9-450a-955e-b3abb96ee281 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:50.977036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2ddfe639-29e9-450a-955e-b3abb96ee281 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:50.978189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2ddfe639-29e9-450a-955e-b3abb96ee281 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:50.979570 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2ddfe639-29e9-450a-955e-b3abb96ee281 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:50.980358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2ddfe639-29e9-450a-955e-b3abb96ee281 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.030697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f9ef7c45-440b-4e96-86a9-b0d678593fa8 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:51.031742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f9ef7c45-440b-4e96-86a9-b0d678593fa8 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:51.052160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f9ef7c45-440b-4e96-86a9-b0d678593fa8 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.052942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f9ef7c45-440b-4e96-86a9-b0d678593fa8 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.054334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f9ef7c45-440b-4e96-86a9-b0d678593fa8 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.066297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f9ef7c45-440b-4e96-86a9-b0d678593fa8 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.293726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f9ef7c45-440b-4e96-86a9-b0d678593fa8 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:51.304164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f9ef7c45-440b-4e96-86a9-b0d678593fa8 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1463 microversion: 2.1 time: 0.295304 Aug 02 09:09:51.305254 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 245/491] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:51 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1463 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:51.311238 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-273bb38a-2e02-492a-ae80-f32b8d10c812 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:51.312117 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-273bb38a-2e02-492a-ae80-f32b8d10c812 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:51.320243 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-273bb38a-2e02-492a-ae80-f32b8d10c812 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.320944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-273bb38a-2e02-492a-ae80-f32b8d10c812 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.321943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-273bb38a-2e02-492a-ae80-f32b8d10c812 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.322541 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-273bb38a-2e02-492a-ae80-f32b8d10c812 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.523218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-273bb38a-2e02-492a-ae80-f32b8d10c812 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:51.530937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-273bb38a-2e02-492a-ae80-f32b8d10c812 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.224367 Aug 02 09:09:51.531587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 246/492] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:51 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:51.536553 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-61ce113b-a118-4e17-a922-0caad8ee2611 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:51.537216 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-61ce113b-a118-4e17-a922-0caad8ee2611 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:51.543855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-61ce113b-a118-4e17-a922-0caad8ee2611 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.544327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-61ce113b-a118-4e17-a922-0caad8ee2611 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.545079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-61ce113b-a118-4e17-a922-0caad8ee2611 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.545516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-61ce113b-a118-4e17-a922-0caad8ee2611 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.550692 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:51.562912 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2ddfe639-29e9-450a-955e-b3abb96ee281 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:51.572063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2ddfe639-29e9-450a-955e-b3abb96ee281 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.613760 Aug 02 09:09:51.572676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 247/493] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:50 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:51.598551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-61ce113b-a118-4e17-a922-0caad8ee2611 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:09:51.950349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-61ce113b-a118-4e17-a922-0caad8ee2611 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "DELETE /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 204 len: 0 microversion: 2.1 time: 0.417495 Aug 02 09:09:51.951475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 247/494] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:09:51 2022] DELETE /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:09:51.960308 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ea90376d-1464-46e8-ab99-0aded4b8ba3f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:51.961074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ea90376d-1464-46e8-ab99-0aded4b8ba3f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:51.967350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea90376d-1464-46e8-ab99-0aded4b8ba3f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.967925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea90376d-1464-46e8-ab99-0aded4b8ba3f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:51.968758 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea90376d-1464-46e8-ab99-0aded4b8ba3f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:51.969088 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea90376d-1464-46e8-ab99-0aded4b8ba3f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.106804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ea90376d-1464-46e8-ab99-0aded4b8ba3f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:52.115936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ea90376d-1464-46e8-ab99-0aded4b8ba3f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.159965 Aug 02 09:09:52.116552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 248/495] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:51 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:52.556888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fee107a8-52cf-4391-a6de-5d6196bb5965 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:52.557574 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fee107a8-52cf-4391-a6de-5d6196bb5965 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:52.564378 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fee107a8-52cf-4391-a6de-5d6196bb5965 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.564821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fee107a8-52cf-4391-a6de-5d6196bb5965 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.565916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fee107a8-52cf-4391-a6de-5d6196bb5965 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.566203 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fee107a8-52cf-4391-a6de-5d6196bb5965 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.594865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5172be95-174c-4dec-b7ef-ece60416a4bc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:52.595477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5172be95-174c-4dec-b7ef-ece60416a4bc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:52.602985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5172be95-174c-4dec-b7ef-ece60416a4bc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.603586 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5172be95-174c-4dec-b7ef-ece60416a4bc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.604583 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5172be95-174c-4dec-b7ef-ece60416a4bc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:52.605028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5172be95-174c-4dec-b7ef-ece60416a4bc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:52.768941 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fee107a8-52cf-4391-a6de-5d6196bb5965 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:52.777588 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fee107a8-52cf-4391-a6de-5d6196bb5965 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.224871 Aug 02 09:09:52.778444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 248/496] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:52 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:52.815951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5172be95-174c-4dec-b7ef-ece60416a4bc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:52.823929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5172be95-174c-4dec-b7ef-ece60416a4bc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.233981 Aug 02 09:09:52.824527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 249/497] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:52 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:53.145941 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1cb7ffd3-9269-4393-aba8-7c8b51c884bd tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:53.146772 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1cb7ffd3-9269-4393-aba8-7c8b51c884bd tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:53.153396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1cb7ffd3-9269-4393-aba8-7c8b51c884bd tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:53.153813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1cb7ffd3-9269-4393-aba8-7c8b51c884bd tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:53.154623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1cb7ffd3-9269-4393-aba8-7c8b51c884bd tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:53.155054 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1cb7ffd3-9269-4393-aba8-7c8b51c884bd tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:53.308782 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1cb7ffd3-9269-4393-aba8-7c8b51c884bd tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:53.316667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1cb7ffd3-9269-4393-aba8-7c8b51c884bd tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.174854 Aug 02 09:09:53.317249 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 249/498] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:53 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:53.800269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-47e39a0f-d854-4d6a-8e79-40cf903abcf2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:53.800939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-47e39a0f-d854-4d6a-8e79-40cf903abcf2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:53.807488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47e39a0f-d854-4d6a-8e79-40cf903abcf2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:53.807935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47e39a0f-d854-4d6a-8e79-40cf903abcf2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:53.808714 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47e39a0f-d854-4d6a-8e79-40cf903abcf2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:53.809150 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47e39a0f-d854-4d6a-8e79-40cf903abcf2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:53.845173 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6fccd813-91fd-4242-8da4-8dd50ddbb30a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:53.847527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6fccd813-91fd-4242-8da4-8dd50ddbb30a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:53.856454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6fccd813-91fd-4242-8da4-8dd50ddbb30a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:53.857292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6fccd813-91fd-4242-8da4-8dd50ddbb30a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:53.858773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6fccd813-91fd-4242-8da4-8dd50ddbb30a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:53.859570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6fccd813-91fd-4242-8da4-8dd50ddbb30a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:53.977209 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-47e39a0f-d854-4d6a-8e79-40cf903abcf2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:53.985760 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-47e39a0f-d854-4d6a-8e79-40cf903abcf2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.189693 Aug 02 09:09:54.002976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 250/499] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:53 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:54.043985 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6fccd813-91fd-4242-8da4-8dd50ddbb30a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:54.052343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6fccd813-91fd-4242-8da4-8dd50ddbb30a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.210904 Aug 02 09:09:54.052921 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 250/500] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:53 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:54.342847 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7c275d08-40f8-443e-97be-96be17d247c0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:54.343588 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7c275d08-40f8-443e-97be-96be17d247c0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:54.350454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c275d08-40f8-443e-97be-96be17d247c0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:54.350904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c275d08-40f8-443e-97be-96be17d247c0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:54.351718 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c275d08-40f8-443e-97be-96be17d247c0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:54.352150 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c275d08-40f8-443e-97be-96be17d247c0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:54.503741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7c275d08-40f8-443e-97be-96be17d247c0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:54.518591 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7c275d08-40f8-443e-97be-96be17d247c0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.179063 Aug 02 09:09:54.520519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 251/501] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:54 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:55.008114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8a1d845e-a5f4-4e89-b682-e64f954ecfdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:55.008114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8a1d845e-a5f4-4e89-b682-e64f954ecfdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:55.014102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a1d845e-a5f4-4e89-b682-e64f954ecfdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.014551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a1d845e-a5f4-4e89-b682-e64f954ecfdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.015322 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a1d845e-a5f4-4e89-b682-e64f954ecfdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.015755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8a1d845e-a5f4-4e89-b682-e64f954ecfdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.084162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9a49e103-e885-4bc6-a5af-45a0d190f326 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:55.084917 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9a49e103-e885-4bc6-a5af-45a0d190f326 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:55.092007 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9a49e103-e885-4bc6-a5af-45a0d190f326 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.092537 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9a49e103-e885-4bc6-a5af-45a0d190f326 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.093434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9a49e103-e885-4bc6-a5af-45a0d190f326 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.093965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9a49e103-e885-4bc6-a5af-45a0d190f326 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.171260 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8a1d845e-a5f4-4e89-b682-e64f954ecfdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:55.179214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8a1d845e-a5f4-4e89-b682-e64f954ecfdc tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1314 microversion: 2.1 time: 0.176135 Aug 02 09:09:55.180254 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 251/502] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:55 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:55.244386 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9a49e103-e885-4bc6-a5af-45a0d190f326 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:55.254333 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9a49e103-e885-4bc6-a5af-45a0d190f326 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.174525 Aug 02 09:09:55.254916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 252/503] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:55 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:55.543141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-54293905-3fd8-494a-9188-7d0e8fca4a91 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:55.543874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-54293905-3fd8-494a-9188-7d0e8fca4a91 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:55.550858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-54293905-3fd8-494a-9188-7d0e8fca4a91 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.551517 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-54293905-3fd8-494a-9188-7d0e8fca4a91 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.552321 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-54293905-3fd8-494a-9188-7d0e8fca4a91 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:55.552762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-54293905-3fd8-494a-9188-7d0e8fca4a91 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:55.747543 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-54293905-3fd8-494a-9188-7d0e8fca4a91 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:55.755988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-54293905-3fd8-494a-9188-7d0e8fca4a91 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.217327 Aug 02 09:09:55.756573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 252/504] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:55 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:56.201058 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-71668ba6-82d1-4720-a371-f3cc6872143b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:56.201858 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-71668ba6-82d1-4720-a371-f3cc6872143b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:56.211686 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-71668ba6-82d1-4720-a371-f3cc6872143b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:56.212281 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-71668ba6-82d1-4720-a371-f3cc6872143b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:56.212945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-71668ba6-82d1-4720-a371-f3cc6872143b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:56.213363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-71668ba6-82d1-4720-a371-f3cc6872143b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:56.278990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cdaccab1-4854-4604-98e2-5c5ad43bb22e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:56.280330 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cdaccab1-4854-4604-98e2-5c5ad43bb22e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:56.294192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cdaccab1-4854-4604-98e2-5c5ad43bb22e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:56.294192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cdaccab1-4854-4604-98e2-5c5ad43bb22e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:56.294192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cdaccab1-4854-4604-98e2-5c5ad43bb22e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:56.294192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cdaccab1-4854-4604-98e2-5c5ad43bb22e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:56.378124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-71668ba6-82d1-4720-a371-f3cc6872143b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:56.387271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-71668ba6-82d1-4720-a371-f3cc6872143b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1498 microversion: 2.1 time: 0.190016 Aug 02 09:09:56.387675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 253/505] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:56 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1498 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:56.455060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-cdaccab1-4854-4604-98e2-5c5ad43bb22e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:56.463341 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cdaccab1-4854-4604-98e2-5c5ad43bb22e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.190220 Aug 02 09:09:56.464276 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 253/506] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:56 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:56.776950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2d58961c-e2a1-474b-87a5-c8de75f72556 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:56.777548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2d58961c-e2a1-474b-87a5-c8de75f72556 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:56.785053 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2d58961c-e2a1-474b-87a5-c8de75f72556 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:56.785727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2d58961c-e2a1-474b-87a5-c8de75f72556 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:56.786722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2d58961c-e2a1-474b-87a5-c8de75f72556 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:56.787149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2d58961c-e2a1-474b-87a5-c8de75f72556 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:56.806011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:56.925552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2d58961c-e2a1-474b-87a5-c8de75f72556 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:56.933571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2d58961c-e2a1-474b-87a5-c8de75f72556 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.160405 Aug 02 09:09:56.934187 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 254/507] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:56 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:57.484943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e8fecdb3-392c-48c6-9d51-b827f702d865 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:57.487490 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e8fecdb3-392c-48c6-9d51-b827f702d865 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:57.492806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e8fecdb3-392c-48c6-9d51-b827f702d865 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:57.493252 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e8fecdb3-392c-48c6-9d51-b827f702d865 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:57.494052 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e8fecdb3-392c-48c6-9d51-b827f702d865 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:57.494482 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e8fecdb3-392c-48c6-9d51-b827f702d865 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:57.615770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7fa13d56-4843-4917-bb58-6c13fc9fd8da tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:57.616362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7fa13d56-4843-4917-bb58-6c13fc9fd8da tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:57.623788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7fa13d56-4843-4917-bb58-6c13fc9fd8da tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:57.624329 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7fa13d56-4843-4917-bb58-6c13fc9fd8da tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:57.625184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7fa13d56-4843-4917-bb58-6c13fc9fd8da tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:57.625816 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7fa13d56-4843-4917-bb58-6c13fc9fd8da tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:57.643287 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e8fecdb3-392c-48c6-9d51-b827f702d865 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:57.651121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e8fecdb3-392c-48c6-9d51-b827f702d865 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.170213 Aug 02 09:09:57.651689 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 254/508] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:57 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:57.657385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7fa13d56-4843-4917-bb58-6c13fc9fd8da tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Going to try to terminate instance {{(pid=118368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:09:57.956082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1f37a413-dbba-423b-acdd-9d5a0499d9c5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:57.956748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1f37a413-dbba-423b-acdd-9d5a0499d9c5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:57.964319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f37a413-dbba-423b-acdd-9d5a0499d9c5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:57.964759 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f37a413-dbba-423b-acdd-9d5a0499d9c5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:57.965561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f37a413-dbba-423b-acdd-9d5a0499d9c5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:57.966029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f37a413-dbba-423b-acdd-9d5a0499d9c5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:57.975066 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7fa13d56-4843-4917-bb58-6c13fc9fd8da tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 204 len: 0 microversion: 2.1 time: 0.363601 Aug 02 09:09:57.975655 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 255/509] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:09:57 2022] DELETE /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:09:57.991811 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-daca6dca-8064-46a1-a166-62c4a3dfe012 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:57.992539 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-daca6dca-8064-46a1-a166-62c4a3dfe012 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:57.998964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-daca6dca-8064-46a1-a166-62c4a3dfe012 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:58.000127 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-daca6dca-8064-46a1-a166-62c4a3dfe012 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:58.001349 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-daca6dca-8064-46a1-a166-62c4a3dfe012 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:58.001954 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-daca6dca-8064-46a1-a166-62c4a3dfe012 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:58.116211 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1f37a413-dbba-423b-acdd-9d5a0499d9c5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:58.124958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1f37a413-dbba-423b-acdd-9d5a0499d9c5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.173678 Aug 02 09:09:58.125829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 255/510] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:57 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:58.168970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-daca6dca-8064-46a1-a166-62c4a3dfe012 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:58.177133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-daca6dca-8064-46a1-a166-62c4a3dfe012 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1504 microversion: 2.1 time: 0.189591 Aug 02 09:09:58.177799 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 256/511] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:57 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:58.299020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-371f00cd-97c0-4b85-961b-50d5dfcc1d06 req-8026e416-5b99-4925-a6b4-21eb2bac7cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93fca05-bed7-45c7-93fb-47a31cdf58f6", "name": "network-vif-plugged", "status": "completed", "tag": "c69e6c6c-a629-4816-a638-07c69b3b85b0"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:09:58.309670 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-371f00cd-97c0-4b85-961b-50d5dfcc1d06 req-8026e416-5b99-4925-a6b4-21eb2bac7cf0 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:58.310292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-371f00cd-97c0-4b85-961b-50d5dfcc1d06 req-8026e416-5b99-4925-a6b4-21eb2bac7cf0 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:58.328084 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-371f00cd-97c0-4b85-961b-50d5dfcc1d06 req-8026e416-5b99-4925-a6b4-21eb2bac7cf0 service nova] Creating event network-vif-plugged:c69e6c6c-a629-4816-a638-07c69b3b85b0 for instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 on hv-cinder-84713 Aug 02 09:09:58.333803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-371f00cd-97c0-4b85-961b-50d5dfcc1d06 req-8026e416-5b99-4925-a6b4-21eb2bac7cf0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038710 Aug 02 09:09:58.334437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 256/512] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:58.672033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9794b22b-d4d4-433f-840f-038fa07671e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:58.672636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9794b22b-d4d4-433f-840f-038fa07671e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:58.679416 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9794b22b-d4d4-433f-840f-038fa07671e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:58.679865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9794b22b-d4d4-433f-840f-038fa07671e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:58.680670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9794b22b-d4d4-433f-840f-038fa07671e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:58.681143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9794b22b-d4d4-433f-840f-038fa07671e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:58.827112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9794b22b-d4d4-433f-840f-038fa07671e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:58.835161 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9794b22b-d4d4-433f-840f-038fa07671e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.166918 Aug 02 09:09:58.835741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 257/513] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:58 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:59.151145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ead74cc7-9026-41c2-bff4-54049546512f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:59.151849 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ead74cc7-9026-41c2-bff4-54049546512f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:59.159151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ead74cc7-9026-41c2-bff4-54049546512f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:59.159603 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ead74cc7-9026-41c2-bff4-54049546512f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:59.160388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ead74cc7-9026-41c2-bff4-54049546512f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:59.160831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ead74cc7-9026-41c2-bff4-54049546512f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:59.201205 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-37864b02-bbe1-4451-928d-e4c1314f95ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:59.201441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-37864b02-bbe1-4451-928d-e4c1314f95ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:59.211527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-37864b02-bbe1-4451-928d-e4c1314f95ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:59.211976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-37864b02-bbe1-4451-928d-e4c1314f95ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:59.213141 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-37864b02-bbe1-4451-928d-e4c1314f95ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:59.213753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-37864b02-bbe1-4451-928d-e4c1314f95ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:59.315380 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ead74cc7-9026-41c2-bff4-54049546512f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:59.323957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ead74cc7-9026-41c2-bff4-54049546512f tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.177691 Aug 02 09:09:59.324556 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 257/514] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:59 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:09:59.364254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-37864b02-bbe1-4451-928d-e4c1314f95ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:09:59.372512 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-37864b02-bbe1-4451-928d-e4c1314f95ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1504 microversion: 2.1 time: 0.176226 Aug 02 09:09:59.373405 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 258/515] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:59 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:09:59.856005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d5739626-b8e8-4744-9cff-d55ba97f66e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:59.856616 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d5739626-b8e8-4744-9cff-d55ba97f66e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:09:59.863712 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5739626-b8e8-4744-9cff-d55ba97f66e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:59.864164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5739626-b8e8-4744-9cff-d55ba97f66e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:59.864983 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5739626-b8e8-4744-9cff-d55ba97f66e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:59.865417 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5739626-b8e8-4744-9cff-d55ba97f66e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:59.995787 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d5739626-b8e8-4744-9cff-d55ba97f66e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:00.003524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d5739626-b8e8-4744-9cff-d55ba97f66e2 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.151482 Aug 02 09:10:00.004261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 258/516] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:09:59 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:00.346009 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1c71d6b5-4f1c-47eb-8718-29359c12fd35 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:00.346653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1c71d6b5-4f1c-47eb-8718-29359c12fd35 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:00.353340 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1c71d6b5-4f1c-47eb-8718-29359c12fd35 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:00.353781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1c71d6b5-4f1c-47eb-8718-29359c12fd35 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:00.354575 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1c71d6b5-4f1c-47eb-8718-29359c12fd35 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:00.355149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1c71d6b5-4f1c-47eb-8718-29359c12fd35 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:00.394292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2920c040-d76e-4578-9a4a-284ed0aefe26 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:00.394892 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2920c040-d76e-4578-9a4a-284ed0aefe26 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:00.401937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2920c040-d76e-4578-9a4a-284ed0aefe26 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:00.402396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2920c040-d76e-4578-9a4a-284ed0aefe26 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:00.403172 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2920c040-d76e-4578-9a4a-284ed0aefe26 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:00.403610 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2920c040-d76e-4578-9a4a-284ed0aefe26 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:00.501350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1c71d6b5-4f1c-47eb-8718-29359c12fd35 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:00.509905 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1c71d6b5-4f1c-47eb-8718-29359c12fd35 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.167673 Aug 02 09:10:00.510436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 259/517] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:00 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:00.551639 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2920c040-d76e-4578-9a4a-284ed0aefe26 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:00.559457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2920c040-d76e-4578-9a4a-284ed0aefe26 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1504 microversion: 2.1 time: 0.169220 Aug 02 09:10:00.560040 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 259/518] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:00 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:01.025437 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8f877331-645f-42ba-b003-5ae094900eb7 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:01.026104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8f877331-645f-42ba-b003-5ae094900eb7 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:01.032270 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8f877331-645f-42ba-b003-5ae094900eb7 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:01.032722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8f877331-645f-42ba-b003-5ae094900eb7 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:01.034168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8f877331-645f-42ba-b003-5ae094900eb7 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:01.034605 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8f877331-645f-42ba-b003-5ae094900eb7 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:01.166315 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8f877331-645f-42ba-b003-5ae094900eb7 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:01.173838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8f877331-645f-42ba-b003-5ae094900eb7 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.152674 Aug 02 09:10:01.174437 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 260/519] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:01 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:01.530921 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d2ffa540-3bd6-4024-9e06-e04179d550b4 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:01.531570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d2ffa540-3bd6-4024-9e06-e04179d550b4 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:01.538715 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d2ffa540-3bd6-4024-9e06-e04179d550b4 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:01.539096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d2ffa540-3bd6-4024-9e06-e04179d550b4 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:01.539860 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d2ffa540-3bd6-4024-9e06-e04179d550b4 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:01.540400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d2ffa540-3bd6-4024-9e06-e04179d550b4 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:01.581688 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ee066beb-1149-4140-b3a5-bd4f3e4a45ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:01.584414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ee066beb-1149-4140-b3a5-bd4f3e4a45ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:01.591564 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee066beb-1149-4140-b3a5-bd4f3e4a45ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:01.592017 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee066beb-1149-4140-b3a5-bd4f3e4a45ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:01.592821 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee066beb-1149-4140-b3a5-bd4f3e4a45ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:01.593526 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee066beb-1149-4140-b3a5-bd4f3e4a45ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:01.761149 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d2ffa540-3bd6-4024-9e06-e04179d550b4 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:01.770916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d2ffa540-3bd6-4024-9e06-e04179d550b4 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1469 microversion: 2.1 time: 0.243811 Aug 02 09:10:01.777553 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 260/520] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:01 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:01.888640 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-d0174b43-b1a6-4f49-90b9-a07059ce1169 req-81c93727-7a7d-4639-b747-a871ce485cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c7098f-f885-4587-a267-8d907a773d3b", "name": "network-vif-deleted", "tag": "a79927d7-7078-4f31-a33d-f99427f2acff"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:01.901459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d0174b43-b1a6-4f49-90b9-a07059ce1169 req-81c93727-7a7d-4639-b747-a871ce485cea service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:01.901950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d0174b43-b1a6-4f49-90b9-a07059ce1169 req-81c93727-7a7d-4639-b747-a871ce485cea service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:01.905993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ee066beb-1149-4140-b3a5-bd4f3e4a45ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:01.917705 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ee066beb-1149-4140-b3a5-bd4f3e4a45ae tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1504 microversion: 2.1 time: 0.340253 Aug 02 09:10:01.918316 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 261/521] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:01 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:01.940372 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-d0174b43-b1a6-4f49-90b9-a07059ce1169 req-81c93727-7a7d-4639-b747-a871ce485cea service nova] Creating event network-vif-deleted:a79927d7-7078-4f31-a33d-f99427f2acff for instance 46c7098f-f885-4587-a267-8d907a773d3b on hv-cinder-84713 Aug 02 09:10:01.947698 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-d0174b43-b1a6-4f49-90b9-a07059ce1169 req-81c93727-7a7d-4639-b747-a871ce485cea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063426 Aug 02 09:10:01.948298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 261/522] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:10:02.195211 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ec975fab-e035-412c-bccb-ea324eeb045c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:02.195925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ec975fab-e035-412c-bccb-ea324eeb045c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:02.202896 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ec975fab-e035-412c-bccb-ea324eeb045c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:02.203337 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ec975fab-e035-412c-bccb-ea324eeb045c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:02.204094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ec975fab-e035-412c-bccb-ea324eeb045c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:02.204518 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ec975fab-e035-412c-bccb-ea324eeb045c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:02.420477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ec975fab-e035-412c-bccb-ea324eeb045c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:02.436785 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ec975fab-e035-412c-bccb-ea324eeb045c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.245149 Aug 02 09:10:02.437590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 262/523] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:02 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:02.793610 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-705775cc-b319-4c4a-8058-fd576030fde7 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:02.794326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-705775cc-b319-4c4a-8058-fd576030fde7 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:02.801075 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-705775cc-b319-4c4a-8058-fd576030fde7 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:02.801370 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-705775cc-b319-4c4a-8058-fd576030fde7 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:02.802163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-705775cc-b319-4c4a-8058-fd576030fde7 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:02.802610 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-705775cc-b319-4c4a-8058-fd576030fde7 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:02.873750 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-705775cc-b319-4c4a-8058-fd576030fde7 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:02.881788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-705775cc-b319-4c4a-8058-fd576030fde7 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1299 microversion: 2.1 time: 0.092871 Aug 02 09:10:02.882392 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 262/524] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:02 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:02.940177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b8569f0a-90b4-472e-8509-eefc655918cb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:02.940792 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b8569f0a-90b4-472e-8509-eefc655918cb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:02.947471 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b8569f0a-90b4-472e-8509-eefc655918cb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:02.947910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b8569f0a-90b4-472e-8509-eefc655918cb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:02.948690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b8569f0a-90b4-472e-8509-eefc655918cb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:02.949114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b8569f0a-90b4-472e-8509-eefc655918cb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:03.022320 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b8569f0a-90b4-472e-8509-eefc655918cb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:03.030266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b8569f0a-90b4-472e-8509-eefc655918cb tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1462 microversion: 2.1 time: 0.094388 Aug 02 09:10:03.030887 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 263/525] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:02 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:03.458164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4717b316-3384-439a-bae6-a3f68d407a9e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:03.458781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4717b316-3384-439a-bae6-a3f68d407a9e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:03.465181 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4717b316-3384-439a-bae6-a3f68d407a9e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:03.465749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4717b316-3384-439a-bae6-a3f68d407a9e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:03.466579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4717b316-3384-439a-bae6-a3f68d407a9e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:03.467015 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4717b316-3384-439a-bae6-a3f68d407a9e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:03.486925 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:03.605742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4717b316-3384-439a-bae6-a3f68d407a9e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:03.613897 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4717b316-3384-439a-bae6-a3f68d407a9e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1370 microversion: 2.1 time: 0.159847 Aug 02 09:10:03.614474 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 263/526] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:03 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:03.902904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:03.903568 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:03.911009 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:03.911464 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:03.912445 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:03.912951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:03.946286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:03.949419 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:03.949419 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lazy-loading 'fault' on Instance uuid 46c7098f-f885-4587-a267-8d907a773d3b {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:03.963679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-d238ae36-a6c9-450a-8119-3397079af21b req-4af042a7-ed62-4de1-ba58-90a053ac9b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4a6d33-3375-4a1c-971f-e531182ecea2", "name": "network-vif-deleted", "tag": "bb49da6e-4d20-4834-977a-8a84e59e7acf"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:03.975095 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d238ae36-a6c9-450a-8119-3397079af21b req-4af042a7-ed62-4de1-ba58-90a053ac9b5e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:03.975540 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d238ae36-a6c9-450a-8119-3397079af21b req-4af042a7-ed62-4de1-ba58-90a053ac9b5e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:03.986970 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-d238ae36-a6c9-450a-8119-3397079af21b req-4af042a7-ed62-4de1-ba58-90a053ac9b5e service nova] Creating event network-vif-deleted:bb49da6e-4d20-4834-977a-8a84e59e7acf for instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 on hv-cinder-84713 Aug 02 09:10:03.992034 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-d238ae36-a6c9-450a-8119-3397079af21b req-4af042a7-ed62-4de1-ba58-90a053ac9b5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032452 Aug 02 09:10:03.992626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 264/527] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:03.993477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:04.001150 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-df015da0-9ea6-4a1f-b588-f01f2327bd2d tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1304 microversion: 2.1 time: 0.102388 Aug 02 09:10:04.001744 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 264/528] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:03 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:04.052523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:04.053414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:04.060558 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:04.061009 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:04.061817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:04.062327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:04.094298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:04.094745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:04.095855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lazy-loading 'fault' on Instance uuid 7e4a6d33-3375-4a1c-971f-e531182ecea2 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:04.141262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:04.150387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b12f9bc9-91b1-4a1d-90e5-0eaf47a20327 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1304 microversion: 2.1 time: 0.102266 Aug 02 09:10:04.150997 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 265/529] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:04 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:04.634834 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2b507c83-a508-4630-bca3-d84fa741f29f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:04.635433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2b507c83-a508-4630-bca3-d84fa741f29f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:04.641515 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b507c83-a508-4630-bca3-d84fa741f29f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:04.641982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b507c83-a508-4630-bca3-d84fa741f29f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:04.642728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b507c83-a508-4630-bca3-d84fa741f29f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:04.643156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b507c83-a508-4630-bca3-d84fa741f29f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:04.777280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2b507c83-a508-4630-bca3-d84fa741f29f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:04.784974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2b507c83-a508-4630-bca3-d84fa741f29f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1563 microversion: 2.1 time: 0.154152 Aug 02 09:10:04.785526 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 265/530] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:04 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:04.806009 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6224c1b2-0330-4904-8314-1acf7b09ac52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:04.806500 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6224c1b2-0330-4904-8314-1acf7b09ac52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:04.812606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6224c1b2-0330-4904-8314-1acf7b09ac52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:04.813051 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6224c1b2-0330-4904-8314-1acf7b09ac52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:04.813872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6224c1b2-0330-4904-8314-1acf7b09ac52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:04.814822 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6224c1b2-0330-4904-8314-1acf7b09ac52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:04.894869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6224c1b2-0330-4904-8314-1acf7b09ac52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093022 Aug 02 09:10:04.895487 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 266/531] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 2 09:10:04 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:05.022070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:05.022710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:05.029741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:05.030239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:05.031031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:05.031459 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:05.065149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:05.065606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:05.066153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lazy-loading 'fault' on Instance uuid 46c7098f-f885-4587-a267-8d907a773d3b {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:05.148160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:05.155835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5c3a7a4f-7f95-409f-bf8c-c084fe6fc0b0 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1304 microversion: 2.1 time: 0.137650 Aug 02 09:10:05.156417 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 266/532] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:05 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:05.180982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:05.181668 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:05.188039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:05.188705 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:05.189446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:05.189910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:05.225090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:05.225782 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:05.226427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lazy-loading 'fault' on Instance uuid 7e4a6d33-3375-4a1c-971f-e531182ecea2 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:05.268353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:05.276007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-35d9444e-650a-4622-a6f6-4e49e21f7b45 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1304 microversion: 2.1 time: 0.099609 Aug 02 09:10:05.276568 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 267/533] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:05 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:06.006816 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-2d2d316d-ffb6-4868-9622-2bd19270cd98 req-e425c0ad-1478-4fc1-8d00-e2090afd3a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93fca05-bed7-45c7-93fb-47a31cdf58f6", "tag": "c69e6c6c-a629-4816-a638-07c69b3b85b0"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:06.016507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-2d2d316d-ffb6-4868-9622-2bd19270cd98 req-e425c0ad-1478-4fc1-8d00-e2090afd3a1f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:06.017602 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-2d2d316d-ffb6-4868-9622-2bd19270cd98 req-e425c0ad-1478-4fc1-8d00-e2090afd3a1f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:06.029736 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-2d2d316d-ffb6-4868-9622-2bd19270cd98 req-e425c0ad-1478-4fc1-8d00-e2090afd3a1f service nova] Creating event network-changed:c69e6c6c-a629-4816-a638-07c69b3b85b0 for instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 on hv-cinder-84713 Aug 02 09:10:06.034789 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-2d2d316d-ffb6-4868-9622-2bd19270cd98 req-e425c0ad-1478-4fc1-8d00-e2090afd3a1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031701 Aug 02 09:10:06.035370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 267/534] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:06.177231 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:06.177841 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:06.184355 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:06.184950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:06.185572 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:06.186059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:06.219459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:06.220034 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:06.221071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lazy-loading 'fault' on Instance uuid 46c7098f-f885-4587-a267-8d907a773d3b {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:06.264146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:06.278692 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-173a6b97-d8a0-42e6-9a49-1bbdcc117e49 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1304 microversion: 2.1 time: 0.105061 Aug 02 09:10:06.279523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 268/535] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:06 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:06.299625 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:06.300435 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:06.307257 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:06.307709 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:06.308965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:06.309485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:06.346079 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:06.346448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:06.346896 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lazy-loading 'fault' on Instance uuid 7e4a6d33-3375-4a1c-971f-e531182ecea2 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:06.389511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:06.398355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7ee2a05c-d254-41d4-bb93-574eab751db7 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1304 microversion: 2.1 time: 0.102783 Aug 02 09:10:06.398951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 268/536] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:06 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:07.300620 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:07.301224 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:07.308436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:07.308817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:07.309599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:07.310077 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:07.346492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:07.347061 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:07.347612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lazy-loading 'fault' on Instance uuid 46c7098f-f885-4587-a267-8d907a773d3b {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:07.393294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:07.401675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-30f5c4e8-6842-4761-af1a-157c7b1c601c tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1304 microversion: 2.1 time: 0.105637 Aug 02 09:10:07.402512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 269/537] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:07 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:07.420483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:07.421119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:07.428369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:07.428814 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:07.429582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:07.430061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:07.434335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:07.461745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:07.462147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:07.462601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lazy-loading 'fault' on Instance uuid 7e4a6d33-3375-4a1c-971f-e531182ecea2 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:07.507919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:07.515595 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c26c80d4-1e95-4657-87ef-15bad7aa892a tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1304 microversion: 2.1 time: 0.099150 Aug 02 09:10:07.516159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 269/538] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:07 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:08.430119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:08.430752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:08.437335 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:08.437778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:08.438569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:08.438996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:08.471866 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:08.472322 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:08.472764 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lazy-loading 'fault' on Instance uuid 46c7098f-f885-4587-a267-8d907a773d3b {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:08.513683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b7380d83c4fcb857a54ae51b68ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a622931a6e284ee1a512fcbfc61e1357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:08.521831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b573a8fe-e843-4752-81f3-26f61b03dcc5 tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 200 len: 1304 microversion: 2.1 time: 0.102230 Aug 02 09:10:08.522419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 270/539] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:08 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:08.542302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:08.542845 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:08.550626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:08.551418 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:08.551725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:08.552215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:08.587172 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:08.587854 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:08.588471 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lazy-loading 'fault' on Instance uuid 7e4a6d33-3375-4a1c-971f-e531182ecea2 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:08.664700 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:08.672425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ade398ff-d0a5-4c55-870c-49cef0857fc2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 200 len: 1304 microversion: 2.1 time: 0.134158 Aug 02 09:10:08.673004 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 270/540] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:08 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:09.543629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:09.544483 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] [instance: 46c7098f-f885-4587-a267-8d907a773d3b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:09.551905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:09.551905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:09.552672 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:09.553108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:09.567045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] HTTP exception thrown: Instance 46c7098f-f885-4587-a267-8d907a773d3b could not be found. Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Request method failure captured: Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b HTTP/1.1 Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OnCTQdR7dcie3QafZ5A85Qn7YvomGF4o3avsfFwU4kG8_bXfJM6oVWxWeJBsvbMlIP0wJHsByitlPOMtSY-aOBT3GqyC2JiSEaClwbTqH5Ap4sNimOpiYv2OWya0cJUJ8j0p6-CMzDldOPOFZzNGA_Kt2XXdV3j34HIg8_Z4z7Mwow Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: a622931a6e284ee1a512fcbfc61e1357 Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-VolumesNegativeTest-1387373870 Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:10:09.568683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a622931a6e284ee1a512fcbfc61e1357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a622931a6e284ee1a512fcbfc61e1357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a622931a6e284ee1a512fcbfc61e1357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a622931a6e284ee1a512fcbfc61e1357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-VolumesNegativeTest-1387373870 Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: a622931a6e284ee1a512fcbfc61e1357 Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-VolumesNegativeTest-1387373870 Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-VolumesNegativeTest-1387373870-project Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 2e2b7380d83c4fcb857a54ae51b68ed0 Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-VolumesNegativeTest-1387373870-project Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 46c7098f-f885-4587-a267-8d907a773d3b could not be found. Aug 02 09:10:09.570279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '46c7098f-f885-4587-a267-8d907a773d3b'} Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c7098f-f885-4587-a267-8d907a773d3b could not be found. Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:09.571161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c7098f-f885-4587-a267-8d907a773d3b could not be found. Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c7098f-f885-4587-a267-8d907a773d3b could not be found. Aug 02 09:10:09.572679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.573968 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] Returning 404 to user: Instance 46c7098f-f885-4587-a267-8d907a773d3b could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:09.573968 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b99f74a6-9c2a-42fc-b9e5-6c0a762fa39b tempest-VolumesNegativeTest-1387373870 tempest-VolumesNegativeTest-1387373870-project] 10.222.0.46 "GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b" status: 404 len: 111 microversion: 2.1 time: 0.030525 Aug 02 09:10:09.573968 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 271/541] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:09 2022] GET /compute/v2.1/servers/46c7098f-f885-4587-a267-8d907a773d3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:09.695193 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:09.695759 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 7e4a6d33-3375-4a1c-971f-e531182ecea2] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:09.702742 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:09.703208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:09.704330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:09.704766 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:09.718378 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] HTTP exception thrown: Instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 could not be found. Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Request method failure captured: Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 HTTP/1.1 Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OnCC0_Gatg6_va94l9CaU-bz5r5tcf0dDlu3Urg2fFou4zDJtn0k1I8MfJEqRKrXP0miO0qvoYiobf3pm16ES6wUHJ6hJf4UELLx6EI6DF6cZlpBxzAvSguw9lJvyNnG0qYJ742HRuoZ-44_6zSTEaHnsdBDwn6QM2SHT_GFGHMsWU Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 3096d9a95111415d893c6fc82ce860c4 Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesActionsTest-59338995 Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:10:09.721184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3096d9a95111415d893c6fc82ce860c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3096d9a95111415d893c6fc82ce860c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3096d9a95111415d893c6fc82ce860c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3096d9a95111415d893c6fc82ce860c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesActionsTest-59338995 Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 3096d9a95111415d893c6fc82ce860c4 Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesActionsTest-59338995 Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesActionsTest-59338995-project Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: d1381b81b5e14cfab800d6d3e8214f00 Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesActionsTest-59338995-project Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 could not be found. Aug 02 09:10:09.723401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '7e4a6d33-3375-4a1c-971f-e531182ecea2'} Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 could not be found. Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:09.724359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 could not be found. Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 could not be found. Aug 02 09:10:09.725745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:09.726952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Returning 404 to user: Instance 7e4a6d33-3375-4a1c-971f-e531182ecea2 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:09.726952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0b9de18f-d796-4c91-ad0b-88660cda5499 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2" status: 404 len: 111 microversion: 2.1 time: 0.031323 Aug 02 09:10:09.726952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 271/542] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:09 2022] GET /compute/v2.1/servers/7e4a6d33-3375-4a1c-971f-e531182ecea2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:09.832471 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-58534442", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "networks": [{"uuid": "7c2a3b39-87f7-4d80-9d95-36c0e3075924"}]}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:09.887155 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] validate_networks() for [('7c2a3b39-87f7-4d80-9d95-36c0e3075924', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:10:10.272778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:10:10.272778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:10:10.272778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:10:10.272778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:10:10.272778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:10:10.276336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:10.276778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:10.277569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:10.278040 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:10.295469 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Getting quotas for project 3096d9a95111415d893c6fc82ce860c4. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:10.299476 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Getting quotas for user d1381b81b5e14cfab800d6d3e8214f00 and project 3096d9a95111415d893c6fc82ce860c4. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:10.310516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:10:10.312811 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:10:10.393270 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d4a9e17b-5432-48b9-8ea4-8ed7a26d9ba5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:10.393757 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d4a9e17b-5432-48b9-8ea4-8ed7a26d9ba5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:10.400470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4a9e17b-5432-48b9-8ea4-8ed7a26d9ba5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:10.400470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4a9e17b-5432-48b9-8ea4-8ed7a26d9ba5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:10.401158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4a9e17b-5432-48b9-8ea4-8ed7a26d9ba5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:10.401588 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d4a9e17b-5432-48b9-8ea4-8ed7a26d9ba5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:10.426754 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d4a9e17b-5432-48b9-8ea4-8ed7a26d9ba5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/ips" status: 200 len: 148 microversion: 2.1 time: 0.037616 Aug 02 09:10:10.428162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 272/543] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:10:10 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:10:10.525016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0f96ec66-2746-485c-965d-412ad172d444 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696232 Aug 02 09:10:10.525666 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 272/544] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:10:10.538900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f991ecfe-a8c8-4d02-a0be-01b95b5d4332 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:10.543264 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f991ecfe-a8c8-4d02-a0be-01b95b5d4332 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:10.633822 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f991ecfe-a8c8-4d02-a0be-01b95b5d4332 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:10.644409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f991ecfe-a8c8-4d02-a0be-01b95b5d4332 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1212 microversion: 2.1 time: 0.109242 Aug 02 09:10:10.650304 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 273/545] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:10 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:11.667233 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-54b0df31-0f67-45b4-8266-dfa0d0efd350 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:11.667870 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-54b0df31-0f67-45b4-8266-dfa0d0efd350 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:11.728822 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-54b0df31-0f67-45b4-8266-dfa0d0efd350 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:11.736491 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-54b0df31-0f67-45b4-8266-dfa0d0efd350 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1212 microversion: 2.1 time: 0.073656 Aug 02 09:10:11.737033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 273/546] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:11 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1212 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:12.756690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6c2cff3e-bf67-41fa-aa17-34354360ec86 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:12.757251 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6c2cff3e-bf67-41fa-aa17-34354360ec86 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:12.764190 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6c2cff3e-bf67-41fa-aa17-34354360ec86 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:12.764635 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6c2cff3e-bf67-41fa-aa17-34354360ec86 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:12.765446 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6c2cff3e-bf67-41fa-aa17-34354360ec86 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:12.766112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6c2cff3e-bf67-41fa-aa17-34354360ec86 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:12.833367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6c2cff3e-bf67-41fa-aa17-34354360ec86 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:12.841239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6c2cff3e-bf67-41fa-aa17-34354360ec86 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1216 microversion: 2.1 time: 0.088663 Aug 02 09:10:12.841809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 274/547] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:12 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:13.862958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-97e53bd6-3409-41bc-b8b4-7f7026f6e909 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:13.863563 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-97e53bd6-3409-41bc-b8b4-7f7026f6e909 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:13.870279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e53bd6-3409-41bc-b8b4-7f7026f6e909 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:13.870727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e53bd6-3409-41bc-b8b4-7f7026f6e909 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:13.871495 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e53bd6-3409-41bc-b8b4-7f7026f6e909 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:13.871932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e53bd6-3409-41bc-b8b4-7f7026f6e909 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:13.937952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-97e53bd6-3409-41bc-b8b4-7f7026f6e909 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:13.950193 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-97e53bd6-3409-41bc-b8b4-7f7026f6e909 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1216 microversion: 2.1 time: 0.090999 Aug 02 09:10:13.950791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 274/548] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:13 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:14.168378 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-20318268-d9e2-4630-b203-22323feafde4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:14.169720 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-20318268-d9e2-4630-b203-22323feafde4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:14.183900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-20318268-d9e2-4630-b203-22323feafde4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:14.184417 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-20318268-d9e2-4630-b203-22323feafde4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:14.185308 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-20318268-d9e2-4630-b203-22323feafde4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:14.185947 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-20318268-d9e2-4630-b203-22323feafde4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:14.226830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-20318268-d9e2-4630-b203-22323feafde4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/ips" status: 200 len: 150 microversion: 2.20 time: 0.062548 Aug 02 09:10:14.230000 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 275/549] 10.222.0.46 () {60 vars in 1289 bytes} [Tue Aug 2 09:10:14 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:10:14.971956 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4301ef59-5fab-4d54-a970-cac3ac3f8df0 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:14.972659 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4301ef59-5fab-4d54-a970-cac3ac3f8df0 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:14.980030 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4301ef59-5fab-4d54-a970-cac3ac3f8df0 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:14.980457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4301ef59-5fab-4d54-a970-cac3ac3f8df0 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:14.981220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4301ef59-5fab-4d54-a970-cac3ac3f8df0 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:14.981652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4301ef59-5fab-4d54-a970-cac3ac3f8df0 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:15.052614 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4301ef59-5fab-4d54-a970-cac3ac3f8df0 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:15.059998 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4301ef59-5fab-4d54-a970-cac3ac3f8df0 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1264 microversion: 2.1 time: 0.092444 Aug 02 09:10:15.060575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 275/550] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:14 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1264 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:16.081230 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-277c4a37-1352-4149-b3ae-d683dd15022b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:16.081913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-277c4a37-1352-4149-b3ae-d683dd15022b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:16.088532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-277c4a37-1352-4149-b3ae-d683dd15022b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:16.088984 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-277c4a37-1352-4149-b3ae-d683dd15022b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:16.089754 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-277c4a37-1352-4149-b3ae-d683dd15022b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:16.090220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-277c4a37-1352-4149-b3ae-d683dd15022b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:16.179271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-277c4a37-1352-4149-b3ae-d683dd15022b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:16.186807 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-277c4a37-1352-4149-b3ae-d683dd15022b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1270 microversion: 2.1 time: 0.109857 Aug 02 09:10:16.187649 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 276/551] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:16 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:17.209323 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-138939e1-0599-484b-9178-7c3423777076 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:17.210072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-138939e1-0599-484b-9178-7c3423777076 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:17.223306 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-138939e1-0599-484b-9178-7c3423777076 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:17.224037 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-138939e1-0599-484b-9178-7c3423777076 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:17.224922 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-138939e1-0599-484b-9178-7c3423777076 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:17.225615 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-138939e1-0599-484b-9178-7c3423777076 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:17.370467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-138939e1-0599-484b-9178-7c3423777076 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:17.378514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-138939e1-0599-484b-9178-7c3423777076 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.173131 Aug 02 09:10:17.379079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 276/552] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:17 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:17.559552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-03bf0e02-913b-4d96-a9aa-a3fc17c10a67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b984f723-80e4-4b64-afb3-4f93ff0b9855"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:17.562072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-03bf0e02-913b-4d96-a9aa-a3fc17c10a67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:17.569352 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-03bf0e02-913b-4d96-a9aa-a3fc17c10a67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:17.571746 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-03bf0e02-913b-4d96-a9aa-a3fc17c10a67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:17.571746 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-03bf0e02-913b-4d96-a9aa-a3fc17c10a67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:17.571746 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-03bf0e02-913b-4d96-a9aa-a3fc17c10a67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:17.686123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-a7caab23-514a-44d3-8f0a-38b68badc318 req-ddb7db19-4239-41e1-94ba-1ab71a77770f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d43a0e-7887-4a93-ae26-045c041fcba5", "tag": "6328fa67-13b6-42b2-817e-2faec73f8327"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:17.692418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:17.698648 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-a7caab23-514a-44d3-8f0a-38b68badc318 req-ddb7db19-4239-41e1-94ba-1ab71a77770f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:17.699338 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-a7caab23-514a-44d3-8f0a-38b68badc318 req-ddb7db19-4239-41e1-94ba-1ab71a77770f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:17.710608 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-a7caab23-514a-44d3-8f0a-38b68badc318 req-ddb7db19-4239-41e1-94ba-1ab71a77770f service nova] Creating event network-changed:6328fa67-13b6-42b2-817e-2faec73f8327 for instance 28d43a0e-7887-4a93-ae26-045c041fcba5 on hv-cinder-84713 Aug 02 09:10:17.715888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-a7caab23-514a-44d3-8f0a-38b68badc318 req-ddb7db19-4239-41e1-94ba-1ab71a77770f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034371 Aug 02 09:10:17.716585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 277/553] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:10:18.401075 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4f334fdf-19e3-47a5-a822-d25061839ad4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:18.401758 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4f334fdf-19e3-47a5-a822-d25061839ad4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:18.409499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4f334fdf-19e3-47a5-a822-d25061839ad4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:18.409972 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4f334fdf-19e3-47a5-a822-d25061839ad4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:18.410748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4f334fdf-19e3-47a5-a822-d25061839ad4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:18.411176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4f334fdf-19e3-47a5-a822-d25061839ad4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:18.543072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4f334fdf-19e3-47a5-a822-d25061839ad4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:18.550718 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4f334fdf-19e3-47a5-a822-d25061839ad4 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.154678 Aug 02 09:10:18.557133 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 278/554] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:18 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:19.571170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-85149e45-b447-4942-af54-52f2b8cdb65c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:19.571867 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-85149e45-b447-4942-af54-52f2b8cdb65c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:19.578597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-85149e45-b447-4942-af54-52f2b8cdb65c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:19.579035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-85149e45-b447-4942-af54-52f2b8cdb65c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:19.579790 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-85149e45-b447-4942-af54-52f2b8cdb65c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:19.580213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-85149e45-b447-4942-af54-52f2b8cdb65c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:19.711681 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-85149e45-b447-4942-af54-52f2b8cdb65c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:19.720115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-85149e45-b447-4942-af54-52f2b8cdb65c tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.152740 Aug 02 09:10:19.720682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 279/555] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:19 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:20.643772 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:20.741260 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5ca23420-4a02-4315-a46b-c98903dba9fe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:20.741927 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5ca23420-4a02-4315-a46b-c98903dba9fe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:20.743916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:20.749282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ca23420-4a02-4315-a46b-c98903dba9fe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:20.749726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ca23420-4a02-4315-a46b-c98903dba9fe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:20.750531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ca23420-4a02-4315-a46b-c98903dba9fe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:20.754774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ca23420-4a02-4315-a46b-c98903dba9fe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:20.891218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5ca23420-4a02-4315-a46b-c98903dba9fe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:20.899026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5ca23420-4a02-4315-a46b-c98903dba9fe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.161503 Aug 02 09:10:20.899529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 280/556] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:20 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:21.919778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a3d81649-8b9a-4b3a-892a-6b46d700de57 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:21.920469 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a3d81649-8b9a-4b3a-892a-6b46d700de57 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:21.922496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=8 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:21.928535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3d81649-8b9a-4b3a-892a-6b46d700de57 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:21.928989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3d81649-8b9a-4b3a-892a-6b46d700de57 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:21.929808 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3d81649-8b9a-4b3a-892a-6b46d700de57 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:21.930277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a3d81649-8b9a-4b3a-892a-6b46d700de57 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:22.089087 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a3d81649-8b9a-4b3a-892a-6b46d700de57 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:22.097176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a3d81649-8b9a-4b3a-892a-6b46d700de57 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.181131 Aug 02 09:10:22.097765 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 281/557] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:21 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:22.603967 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-03bf0e02-913b-4d96-a9aa-a3fc17c10a67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.047906 Aug 02 09:10:22.604825 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 277/558] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:10:17 2022] POST /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments => generated 194 bytes in 5050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:23.118532 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-74d57914-39e4-4cc3-8ae2-cc4eac2e168d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:23.119088 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-74d57914-39e4-4cc3-8ae2-cc4eac2e168d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:23.125547 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74d57914-39e4-4cc3-8ae2-cc4eac2e168d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:23.126042 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74d57914-39e4-4cc3-8ae2-cc4eac2e168d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:23.126814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74d57914-39e4-4cc3-8ae2-cc4eac2e168d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:23.127312 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74d57914-39e4-4cc3-8ae2-cc4eac2e168d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:23.145802 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:23.256689 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-74d57914-39e4-4cc3-8ae2-cc4eac2e168d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:23.264468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-74d57914-39e4-4cc3-8ae2-cc4eac2e168d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.149876 Aug 02 09:10:23.265028 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 282/559] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:23 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:23.891072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-953dd8ed-4f90-4d5f-9e26-dd75ad311f96 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:23.891672 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-953dd8ed-4f90-4d5f-9e26-dd75ad311f96 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:23.894938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:23.900056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-953dd8ed-4f90-4d5f-9e26-dd75ad311f96 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:23.900502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-953dd8ed-4f90-4d5f-9e26-dd75ad311f96 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:23.901267 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-953dd8ed-4f90-4d5f-9e26-dd75ad311f96 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:23.901749 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-953dd8ed-4f90-4d5f-9e26-dd75ad311f96 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:23.925254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-953dd8ed-4f90-4d5f-9e26-dd75ad311f96 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lazy-loading 'flavor' on Instance uuid 6c248147-71ed-4f5f-89cc-8ca12974efb4 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:24.286429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8b82842e-bad7-4bf1-a8f5-19c51e7a908f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:24.287119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8b82842e-bad7-4bf1-a8f5-19c51e7a908f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:24.293919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8b82842e-bad7-4bf1-a8f5-19c51e7a908f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:24.294637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8b82842e-bad7-4bf1-a8f5-19c51e7a908f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:24.295416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8b82842e-bad7-4bf1-a8f5-19c51e7a908f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:24.296507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8b82842e-bad7-4bf1-a8f5-19c51e7a908f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:24.457705 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8b82842e-bad7-4bf1-a8f5-19c51e7a908f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:24.465614 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8b82842e-bad7-4bf1-a8f5-19c51e7a908f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.183748 Aug 02 09:10:24.466227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 283/560] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:24 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:24.568462 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-953dd8ed-4f90-4d5f-9e26-dd75ad311f96 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/action" status: 202 len: 0 microversion: 2.20 time: 0.681474 Aug 02 09:10:24.569061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 278/561] 10.222.0.46 () {62 vars in 1319 bytes} [Tue Aug 2 09:10:23 2022] POST /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:10:24.577602 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:24.578232 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:24.585705 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:24.586187 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:24.587389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:24.588094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:24.737176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:24.747470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:24.752859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:24.752859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-502bd19c-b6e9-4c1a-8ff4-c8684d50be5d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.176677 Aug 02 09:10:24.752859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 284/562] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:24 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:25.490274 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4f3b4401-9b1e-4b03-b696-de3065cdc402 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:25.490890 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4f3b4401-9b1e-4b03-b696-de3065cdc402 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:25.499083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f3b4401-9b1e-4b03-b696-de3065cdc402 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:25.499671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f3b4401-9b1e-4b03-b696-de3065cdc402 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:25.500724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f3b4401-9b1e-4b03-b696-de3065cdc402 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:25.501159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f3b4401-9b1e-4b03-b696-de3065cdc402 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:25.665766 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4f3b4401-9b1e-4b03-b696-de3065cdc402 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:25.675074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4f3b4401-9b1e-4b03-b696-de3065cdc402 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.189652 Aug 02 09:10:25.675656 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 279/563] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:25 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:25.774312 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:25.774834 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:25.781259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:25.781836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:25.782634 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:25.783565 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:25.918749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:25.930374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:25.931987 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:25.933072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5ab5c34d-3641-4f11-b9b5-536af296e937 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.162718 Aug 02 09:10:25.944032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 285/564] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:25 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:26.696930 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8b3cf6f3-4447-449a-83b8-79f3de89fa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:26.697526 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8b3cf6f3-4447-449a-83b8-79f3de89fa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:26.705907 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8b3cf6f3-4447-449a-83b8-79f3de89fa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:26.706522 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8b3cf6f3-4447-449a-83b8-79f3de89fa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:26.707350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8b3cf6f3-4447-449a-83b8-79f3de89fa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:26.707787 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8b3cf6f3-4447-449a-83b8-79f3de89fa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:26.847652 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8b3cf6f3-4447-449a-83b8-79f3de89fa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:26.855231 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8b3cf6f3-4447-449a-83b8-79f3de89fa52 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.162300 Aug 02 09:10:26.855792 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 280/565] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:26 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:26.956007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:26.956682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:26.963084 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:26.963535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:26.964465 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:26.964867 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:27.098085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:27.106121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:27.107647 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:27.108803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9a8167c8-8e2d-465f-867d-2a8cec231fb6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.156833 Aug 02 09:10:27.109367 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 286/566] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:26 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:27.878023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-72661516-503d-4ef2-af92-e722b23f7cf6 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:27.878631 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-72661516-503d-4ef2-af92-e722b23f7cf6 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:27.885091 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72661516-503d-4ef2-af92-e722b23f7cf6 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:27.885538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72661516-503d-4ef2-af92-e722b23f7cf6 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:27.886333 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72661516-503d-4ef2-af92-e722b23f7cf6 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:27.886768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72661516-503d-4ef2-af92-e722b23f7cf6 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:28.025517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-72661516-503d-4ef2-af92-e722b23f7cf6 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:28.032886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-72661516-503d-4ef2-af92-e722b23f7cf6 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.159399 Aug 02 09:10:28.033437 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 281/567] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:27 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:28.132645 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:28.133251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:28.139870 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:28.140315 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:28.141072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:28.141527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:28.274557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:28.282371 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:28.283862 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:28.284990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7e354fc9-0e1c-4d10-a680-d63a8b7c1e7c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.156212 Aug 02 09:10:28.285548 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 287/568] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:28 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:29.053190 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a89bad1b-df08-4883-b26c-d864a9f2e704 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:29.056229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a89bad1b-df08-4883-b26c-d864a9f2e704 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:29.060756 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a89bad1b-df08-4883-b26c-d864a9f2e704 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:29.061375 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a89bad1b-df08-4883-b26c-d864a9f2e704 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:29.065228 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a89bad1b-df08-4883-b26c-d864a9f2e704 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:29.065835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a89bad1b-df08-4883-b26c-d864a9f2e704 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:29.194335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a89bad1b-df08-4883-b26c-d864a9f2e704 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:29.201970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a89bad1b-df08-4883-b26c-d864a9f2e704 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.152745 Aug 02 09:10:29.202526 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 282/569] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:29 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:29.308229 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:29.308760 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:29.315208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:29.315660 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:29.316429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:29.316863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:29.449336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:29.457905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:29.459395 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:29.460564 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c680ac2a-cbca-47c0-9136-9354fefd5ed4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.156509 Aug 02 09:10:29.461119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 288/570] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:29 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:30.222889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-526beaf8-1dd6-41e6-a97a-31886441e7fd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:30.223482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-526beaf8-1dd6-41e6-a97a-31886441e7fd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:30.230008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-526beaf8-1dd6-41e6-a97a-31886441e7fd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:30.230465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-526beaf8-1dd6-41e6-a97a-31886441e7fd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:30.231215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-526beaf8-1dd6-41e6-a97a-31886441e7fd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:30.231639 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-526beaf8-1dd6-41e6-a97a-31886441e7fd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:30.366019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-526beaf8-1dd6-41e6-a97a-31886441e7fd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:30.373329 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-526beaf8-1dd6-41e6-a97a-31886441e7fd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.154188 Aug 02 09:10:30.373934 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 283/571] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:30 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:30.483734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:30.484412 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:30.490909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:30.491356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:30.492112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:30.492541 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:30.628005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:30.636050 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:30.641377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:30.641377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ea2f8550-6090-4f61-ad57-aff8aba6ab19 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.158927 Aug 02 09:10:30.641377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 289/572] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:30 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:31.252523 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-09f90785-6232-4856-a7de-bb280e2f67b0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:31.253038 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-09f90785-6232-4856-a7de-bb280e2f67b0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:31.260109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09f90785-6232-4856-a7de-bb280e2f67b0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:31.260565 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09f90785-6232-4856-a7de-bb280e2f67b0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:31.261337 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09f90785-6232-4856-a7de-bb280e2f67b0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:31.261774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09f90785-6232-4856-a7de-bb280e2f67b0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:31.291537 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:31.398959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-96906e5a-a299-497a-8a01-b8650ef5ccd2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:31.398959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-96906e5a-a299-497a-8a01-b8650ef5ccd2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:31.404146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96906e5a-a299-497a-8a01-b8650ef5ccd2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:31.404838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96906e5a-a299-497a-8a01-b8650ef5ccd2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:31.406525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96906e5a-a299-497a-8a01-b8650ef5ccd2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:31.407130 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96906e5a-a299-497a-8a01-b8650ef5ccd2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:31.407255 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-09f90785-6232-4856-a7de-bb280e2f67b0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lazy-loading 'services' on Instance uuid 6df72120-5785-40dc-94eb-4fb66b4a8fc0 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:31.549662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-96906e5a-a299-497a-8a01-b8650ef5ccd2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:31.557231 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-96906e5a-a299-497a-8a01-b8650ef5ccd2 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.165700 Aug 02 09:10:31.558158 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 290/573] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:31 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:31.662952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:31.663520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:31.669463 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:31.669931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:31.670694 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:31.671119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:31.811962 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:31.820971 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:31.822527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:31.823950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-70eafc92-b6f2-4e25-a94f-b7d7c1f4bf94 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.164966 Aug 02 09:10:31.824510 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 291/574] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:31 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:10:32.003931 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-09f90785-6232-4856-a7de-bb280e2f67b0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0/os-volume_attachments/5ca83626-7431-4bce-92e8-fae85a8ac536" status: 202 len: 0 microversion: 2.1 time: 0.755478 Aug 02 09:10:32.004512 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 284/575] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:10:31 2022] DELETE /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0/os-volume_attachments/5ca83626-7431-4bce-92e8-fae85a8ac536 => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:10:32.579454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-352e96a3-23ee-45d8-9763-23aaaac7d9cf tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:32.580044 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-352e96a3-23ee-45d8-9763-23aaaac7d9cf tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:32.586773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-352e96a3-23ee-45d8-9763-23aaaac7d9cf tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:32.587215 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-352e96a3-23ee-45d8-9763-23aaaac7d9cf tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:32.587964 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-352e96a3-23ee-45d8-9763-23aaaac7d9cf tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:32.588390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-352e96a3-23ee-45d8-9763-23aaaac7d9cf tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:32.849261 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:32.849983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:32.856795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:32.857250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:32.858058 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:32.858496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:32.963499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-352e96a3-23ee-45d8-9763-23aaaac7d9cf tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:32.974702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-352e96a3-23ee-45d8-9763-23aaaac7d9cf tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.398891 Aug 02 09:10:32.975482 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 292/576] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:32 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:33.009673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:33.019473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:33.021097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:33.022349 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-973ca01d-96bf-4032-8742-4b7db4fd049c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.178298 Aug 02 09:10:33.022891 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 285/577] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:32 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:10:33.800795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-0ca187b8-911e-4d45-9b5b-ece3c3c36880 req-19f32e5e-ab39-4b8c-a0af-77eeb3d9dcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d43a0e-7887-4a93-ae26-045c041fcba5", "name": "network-vif-plugged", "status": "completed", "tag": "6328fa67-13b6-42b2-817e-2faec73f8327"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:33.810979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-0ca187b8-911e-4d45-9b5b-ece3c3c36880 req-19f32e5e-ab39-4b8c-a0af-77eeb3d9dcbb service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:33.811424 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-0ca187b8-911e-4d45-9b5b-ece3c3c36880 req-19f32e5e-ab39-4b8c-a0af-77eeb3d9dcbb service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:33.823821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-0ca187b8-911e-4d45-9b5b-ece3c3c36880 req-19f32e5e-ab39-4b8c-a0af-77eeb3d9dcbb service nova] Creating event network-vif-plugged:6328fa67-13b6-42b2-817e-2faec73f8327 for instance 28d43a0e-7887-4a93-ae26-045c041fcba5 on hv-cinder-84713 Aug 02 09:10:33.828778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-0ca187b8-911e-4d45-9b5b-ece3c3c36880 req-19f32e5e-ab39-4b8c-a0af-77eeb3d9dcbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032518 Aug 02 09:10:33.829381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 293/578] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:33.995328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-df054b32-6ae8-4709-9e73-177a5bed1887 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:33.996392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-df054b32-6ae8-4709-9e73-177a5bed1887 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:34.002610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df054b32-6ae8-4709-9e73-177a5bed1887 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:34.003051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df054b32-6ae8-4709-9e73-177a5bed1887 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:34.003804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df054b32-6ae8-4709-9e73-177a5bed1887 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:34.004328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df054b32-6ae8-4709-9e73-177a5bed1887 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:34.046398 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:34.047111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:34.054813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:34.055358 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:34.056204 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:34.056708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:34.158334 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-df054b32-6ae8-4709-9e73-177a5bed1887 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:34.166494 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-df054b32-6ae8-4709-9e73-177a5bed1887 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.174849 Aug 02 09:10:34.167698 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 286/579] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:33 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:34.235273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:34.238018 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:34.239528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:34.240690 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dbb36f86-faff-4090-ad32-486a3f57f6fa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.199218 Aug 02 09:10:34.241274 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 294/580] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:34 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:10:35.189123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cf771bff-9050-4c54-91d5-4729e0890c1b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:35.190245 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cf771bff-9050-4c54-91d5-4729e0890c1b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:35.197753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cf771bff-9050-4c54-91d5-4729e0890c1b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:35.198545 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cf771bff-9050-4c54-91d5-4729e0890c1b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:35.199317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cf771bff-9050-4c54-91d5-4729e0890c1b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:35.199745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cf771bff-9050-4c54-91d5-4729e0890c1b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:35.264208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:35.264816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:35.272484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:35.273186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:35.273985 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:35.274422 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:35.348924 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cf771bff-9050-4c54-91d5-4729e0890c1b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:35.358545 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cf771bff-9050-4c54-91d5-4729e0890c1b tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1312 microversion: 2.1 time: 0.174263 Aug 02 09:10:35.369922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 287/581] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:35 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:35.410554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:35.418579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:35.420066 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:35.421259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8c28e900-960a-4355-b11b-38655c811a2c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.161168 Aug 02 09:10:35.421808 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 295/582] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:35 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:36.380880 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-44770210-4aeb-4765-98d2-8240300d8bbe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:36.381510 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-44770210-4aeb-4765-98d2-8240300d8bbe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:36.388068 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-44770210-4aeb-4765-98d2-8240300d8bbe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:36.388519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-44770210-4aeb-4765-98d2-8240300d8bbe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:36.389317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-44770210-4aeb-4765-98d2-8240300d8bbe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:36.389715 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-44770210-4aeb-4765-98d2-8240300d8bbe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:36.444580 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:36.445176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:36.452371 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:36.453046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:36.453822 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:36.454297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:36.529389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-44770210-4aeb-4765-98d2-8240300d8bbe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:36.538680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-44770210-4aeb-4765-98d2-8240300d8bbe tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1496 microversion: 2.1 time: 0.162101 Aug 02 09:10:36.539450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 288/583] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:36 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:36.592366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:36.603318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:36.604806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:36.606027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-89171358-2fa2-4e5b-b8c8-c203b3442e55 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.165787 Aug 02 09:10:36.606606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 296/584] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:36 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:10:37.630275 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:37.630801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:37.637464 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:37.637929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:37.638703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:37.639135 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:37.793451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:37.803371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:37.804986 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:37.806482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ddb7af07-9fa8-4c21-b721-0d41374733a6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.180530 Aug 02 09:10:37.808202 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 289/585] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:37 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:37.844641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1865ceff-eab7-4a11-a186-442a5088c393 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:37.845224 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1865ceff-eab7-4a11-a186-442a5088c393 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:37.851897 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1865ceff-eab7-4a11-a186-442a5088c393 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:37.852299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1865ceff-eab7-4a11-a186-442a5088c393 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:37.853069 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1865ceff-eab7-4a11-a186-442a5088c393 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:37.854290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1865ceff-eab7-4a11-a186-442a5088c393 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:37.887322 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1865ceff-eab7-4a11-a186-442a5088c393 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:10:38.203703 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1865ceff-eab7-4a11-a186-442a5088c393 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "DELETE /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 204 len: 0 microversion: 2.1 time: 0.363149 Aug 02 09:10:38.204297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 297/586] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:10:37 2022] DELETE /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:10:38.213229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fd9e65ac-137f-4607-a58c-45d360057d04 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:38.214004 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fd9e65ac-137f-4607-a58c-45d360057d04 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:38.220501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd9e65ac-137f-4607-a58c-45d360057d04 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:38.220973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd9e65ac-137f-4607-a58c-45d360057d04 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:38.223973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd9e65ac-137f-4607-a58c-45d360057d04 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:38.223973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd9e65ac-137f-4607-a58c-45d360057d04 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:38.358176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fd9e65ac-137f-4607-a58c-45d360057d04 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:38.366334 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fd9e65ac-137f-4607-a58c-45d360057d04 tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1502 microversion: 2.1 time: 0.157200 Aug 02 09:10:38.366905 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 290/587] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:38 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:38.840702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:38.841509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:38.848309 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:38.848930 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:38.849502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:38.849994 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:38.854570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:38.987840 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:38.997657 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:38.999304 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:39.000551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ce1541ce-dd41-4ea9-865c-661a958c3288 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.164082 Aug 02 09:10:39.001205 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 298/588] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:38 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:39.387680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8cc6300b-f1c0-4be9-8729-2276d67c541d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:39.388210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8cc6300b-f1c0-4be9-8729-2276d67c541d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:39.396254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8cc6300b-f1c0-4be9-8729-2276d67c541d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:39.396709 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8cc6300b-f1c0-4be9-8729-2276d67c541d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:39.397512 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8cc6300b-f1c0-4be9-8729-2276d67c541d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:39.397975 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8cc6300b-f1c0-4be9-8729-2276d67c541d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:39.533024 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8cc6300b-f1c0-4be9-8729-2276d67c541d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:39.541319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8cc6300b-f1c0-4be9-8729-2276d67c541d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1502 microversion: 2.1 time: 0.157605 Aug 02 09:10:39.541877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 291/589] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:39 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:40.024748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:40.025359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:40.032134 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:40.032582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:40.033348 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:40.033868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:40.164946 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:40.173504 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:40.175071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:40.176967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-efd0dafd-ede7-4446-aeca-b15fe5658619 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.156468 Aug 02 09:10:40.177525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 299/590] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:40 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:40.563013 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e539cec2-0b53-44a8-a1c5-cdf30b09bf2e tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:40.563648 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e539cec2-0b53-44a8-a1c5-cdf30b09bf2e tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:40.571064 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e539cec2-0b53-44a8-a1c5-cdf30b09bf2e tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:40.571513 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e539cec2-0b53-44a8-a1c5-cdf30b09bf2e tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:40.572303 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e539cec2-0b53-44a8-a1c5-cdf30b09bf2e tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:40.572743 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e539cec2-0b53-44a8-a1c5-cdf30b09bf2e tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:40.706972 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e539cec2-0b53-44a8-a1c5-cdf30b09bf2e tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:40.715123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e539cec2-0b53-44a8-a1c5-cdf30b09bf2e tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1502 microversion: 2.1 time: 0.156147 Aug 02 09:10:40.715889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 292/591] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:40 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:41.200949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:41.201652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:41.208288 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:41.208742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:41.209515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:41.209978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:41.356663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:41.366481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:41.368482 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:41.369756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d842db37-6d9b-4472-927a-b21223a59fab tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.173555 Aug 02 09:10:41.370390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 300/592] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:41 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:41.487661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-466d536d-846b-4e92-a4c9-e08152dba94a req-269d8369-fa1b-4b61-94d1-7938d3c8b0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d43a0e-7887-4a93-ae26-045c041fcba5", "name": "network-vif-deleted", "tag": "6328fa67-13b6-42b2-817e-2faec73f8327"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:41.497775 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-466d536d-846b-4e92-a4c9-e08152dba94a req-269d8369-fa1b-4b61-94d1-7938d3c8b0e0 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:41.498240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-466d536d-846b-4e92-a4c9-e08152dba94a req-269d8369-fa1b-4b61-94d1-7938d3c8b0e0 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:41.510819 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-466d536d-846b-4e92-a4c9-e08152dba94a req-269d8369-fa1b-4b61-94d1-7938d3c8b0e0 service nova] Creating event network-vif-deleted:6328fa67-13b6-42b2-817e-2faec73f8327 for instance 28d43a0e-7887-4a93-ae26-045c041fcba5 on hv-cinder-84713 Aug 02 09:10:41.515862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-466d536d-846b-4e92-a4c9-e08152dba94a req-269d8369-fa1b-4b61-94d1-7938d3c8b0e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031851 Aug 02 09:10:41.516801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 293/593] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:41.737209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f8b1ffb5-7cb1-411c-90d4-8990d25ebf7d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:41.737833 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f8b1ffb5-7cb1-411c-90d4-8990d25ebf7d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:41.745646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f8b1ffb5-7cb1-411c-90d4-8990d25ebf7d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:41.746267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f8b1ffb5-7cb1-411c-90d4-8990d25ebf7d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:41.747056 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f8b1ffb5-7cb1-411c-90d4-8990d25ebf7d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:41.747489 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f8b1ffb5-7cb1-411c-90d4-8990d25ebf7d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:41.813365 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f8b1ffb5-7cb1-411c-90d4-8990d25ebf7d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:41.821057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f8b1ffb5-7cb1-411c-90d4-8990d25ebf7d tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1297 microversion: 2.1 time: 0.088231 Aug 02 09:10:41.821635 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 301/594] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:41 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:42.133330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-64f8646a-aed6-47be-b7b1-a33b576e9e7f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: .version_select at 0x7f0f2d71bc10>, body: {"keypair": {"name": "tempest-keypair-1695353741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvlHPsfOe013V0kiK8BX/AwJHWBn5p58xBSLsyHjJhTTqXHieVu36HWsX616O95wtPdkFaHrBdjwHbFuurrltOgM/WzD6fIHZqEYow/7TfKYwfRqRTP6W5DoX6MKZgQUw=="}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:42.151400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-64f8646a-aed6-47be-b7b1-a33b576e9e7f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for project b9df882a572a4bed8966779e50eb7e7c. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:42.156959 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-64f8646a-aed6-47be-b7b1-a33b576e9e7f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for user 806f0c03435e4c5daeadaa4eb437d936 and project b9df882a572a4bed8966779e50eb7e7c. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:42.366828 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-64f8646a-aed6-47be-b7b1-a33b576e9e7f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.237947 Aug 02 09:10:42.367896 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 294/595] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:10:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:42.392775 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:42.393375 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:42.400177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:42.400624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:42.401553 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:42.402043 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:42.570398 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:42.578905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:42.580523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:42.581712 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2d5d9c5d-07e9-4809-8058-f89a13ceb361 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.192999 Aug 02 09:10:42.582973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 302/596] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:42 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:42.845509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:42.846436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:42.853717 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:42.854193 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:42.854974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:42.855415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:42.891384 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:42.891836 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:42.892463 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lazy-loading 'fault' on Instance uuid 28d43a0e-7887-4a93-ae26-045c041fcba5 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:42.935804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1381b81b5e14cfab800d6d3e8214f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3096d9a95111415d893c6fc82ce860c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:42.945002 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5c87339b-3f0e-4f67-af06-812b8d37aafd tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 200 len: 1302 microversion: 2.1 time: 0.105047 Aug 02 09:10:42.945584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 295/597] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:42 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:43.033552 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e3032c28-7c84-4590-8aff-adc0043d5125 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:43.034166 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e3032c28-7c84-4590-8aff-adc0043d5125 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:43.041239 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3032c28-7c84-4590-8aff-adc0043d5125 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:43.041761 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3032c28-7c84-4590-8aff-adc0043d5125 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:43.042628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3032c28-7c84-4590-8aff-adc0043d5125 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:43.043134 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3032c28-7c84-4590-8aff-adc0043d5125 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:43.073019 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e3032c28-7c84-4590-8aff-adc0043d5125 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:10:43.455506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e3032c28-7c84-4590-8aff-adc0043d5125 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 204 len: 0 microversion: 2.1 time: 0.425719 Aug 02 09:10:43.456840 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 303/598] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:10:43 2022] DELETE /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:10:43.465092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-91f56f52-f578-4bf8-92c3-aefe46bcd887 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:43.465701 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-91f56f52-f578-4bf8-92c3-aefe46bcd887 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:43.472481 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-91f56f52-f578-4bf8-92c3-aefe46bcd887 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:43.473087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-91f56f52-f578-4bf8-92c3-aefe46bcd887 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:43.473913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-91f56f52-f578-4bf8-92c3-aefe46bcd887 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:43.474349 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-91f56f52-f578-4bf8-92c3-aefe46bcd887 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:43.605664 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:43.606387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:43.612666 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:43.613100 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-91f56f52-f578-4bf8-92c3-aefe46bcd887 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:43.613241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:43.614497 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:43.614954 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:43.627050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-91f56f52-f578-4bf8-92c3-aefe46bcd887 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.165678 Aug 02 09:10:43.642177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 296/599] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:43 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:43.849868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:43.858417 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:43.859938 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:43.861102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a7a29bb1-253e-4fc8-9562-04fdcea2294d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.259698 Aug 02 09:10:43.861666 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 304/600] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:43 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:10:43.967561 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:43.968180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] [instance: 28d43a0e-7887-4a93-ae26-045c041fcba5] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:43.974610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:43.974992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:43.975895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:43.976293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:43.990761 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] HTTP exception thrown: Instance 28d43a0e-7887-4a93-ae26-045c041fcba5 could not be found. Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Request method failure captured: Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 HTTP/1.1 Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OnCC0_Gatg6_va94l9CaU-bz5r5tcf0dDlu3Urg2fFou4zDJtn0k1I8MfJEqRKrXP0miO0qvoYiobf3pm16ES6wUHJ6hJf4UELLx6EI6DF6cZlpBxzAvSguw9lJvyNnG0qYJ742HRuoZ-44_6zSTEaHnsdBDwn6QM2SHT_GFGHMsWU Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 3096d9a95111415d893c6fc82ce860c4 Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesActionsTest-59338995 Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:10:43.992530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3096d9a95111415d893c6fc82ce860c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3096d9a95111415d893c6fc82ce860c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3096d9a95111415d893c6fc82ce860c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3096d9a95111415d893c6fc82ce860c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesActionsTest-59338995 Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 3096d9a95111415d893c6fc82ce860c4 Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesActionsTest-59338995 Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesActionsTest-59338995-project Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: d1381b81b5e14cfab800d6d3e8214f00 Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesActionsTest-59338995-project Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 28d43a0e-7887-4a93-ae26-045c041fcba5 could not be found. Aug 02 09:10:43.994123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '28d43a0e-7887-4a93-ae26-045c041fcba5'} Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d43a0e-7887-4a93-ae26-045c041fcba5 could not be found. Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:43.995620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d43a0e-7887-4a93-ae26-045c041fcba5 could not be found. Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d43a0e-7887-4a93-ae26-045c041fcba5 could not be found. Aug 02 09:10:43.997095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:43.998614 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] Returning 404 to user: Instance 28d43a0e-7887-4a93-ae26-045c041fcba5 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:43.998614 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-93cfcad5-23fe-4042-b2e9-3d49890d326f tempest-VolumesActionsTest-59338995 tempest-VolumesActionsTest-59338995-project] 10.222.0.46 "GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5" status: 404 len: 111 microversion: 2.1 time: 0.030426 Aug 02 09:10:43.998614 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 297/601] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:43 2022] GET /compute/v2.1/servers/28d43a0e-7887-4a93-ae26-045c041fcba5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:44.649896 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1c9c1b31-4168-4902-8386-7b9dff549e11 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:44.650523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1c9c1b31-4168-4902-8386-7b9dff549e11 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:44.662854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c9c1b31-4168-4902-8386-7b9dff549e11 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:44.668494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c9c1b31-4168-4902-8386-7b9dff549e11 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:44.668494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c9c1b31-4168-4902-8386-7b9dff549e11 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:44.668494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c9c1b31-4168-4902-8386-7b9dff549e11 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:44.843712 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1c9c1b31-4168-4902-8386-7b9dff549e11 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:44.853722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1c9c1b31-4168-4902-8386-7b9dff549e11 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.207781 Aug 02 09:10:44.854339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 305/602] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:44 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:44.884596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:44.885426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:44.892897 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:44.893476 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:44.894378 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:44.899050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:45.006795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1272657812", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "406c2791-4e79-4511-a29d-6d14a120682a"}], "security_groups": [{"name": "tempest-securitygroup--136246393"}], "key_name": "tempest-keypair-1695353741", "user_data": "}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:45.053431 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:45.064500 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:45.066125 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:45.067893 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cedfaa8d-6dce-4561-8f56-80339c7af274 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.187266 Aug 02 09:10:45.068702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 298/603] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:44 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:45.128261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] validate_networks() for [('406c2791-4e79-4511-a29d-6d14a120682a', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:10:45.524679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:10:45.525105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:10:45.525579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:10:45.526027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:10:45.526446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:10:45.536323 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:45.536788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:45.537579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:45.538040 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:45.556503 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for project b9df882a572a4bed8966779e50eb7e7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:45.561092 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for user 806f0c03435e4c5daeadaa4eb437d936 and project b9df882a572a4bed8966779e50eb7e7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:45.572519 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:10:45.574739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:10:45.716990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d42f5466-7eb9-4aef-aade-8c0416724120 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.714647 Aug 02 09:10:45.717826 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 306/604] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:10:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:10:45.729423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2b79c621-9401-48a7-8cb5-d6eb8c730c26 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:45.730061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2b79c621-9401-48a7-8cb5-d6eb8c730c26 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:45.787032 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2b79c621-9401-48a7-8cb5-d6eb8c730c26 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:45.793730 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2b79c621-9401-48a7-8cb5-d6eb8c730c26 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1242 microversion: 2.1 time: 0.068110 Aug 02 09:10:45.794467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 299/605] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:45 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:45.877738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-734da063-c26a-48f7-933d-efa716271be6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:45.878384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-734da063-c26a-48f7-933d-efa716271be6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:45.886099 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-734da063-c26a-48f7-933d-efa716271be6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:45.886547 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-734da063-c26a-48f7-933d-efa716271be6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:45.887318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-734da063-c26a-48f7-933d-efa716271be6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:45.887752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-734da063-c26a-48f7-933d-efa716271be6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:46.024611 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-734da063-c26a-48f7-933d-efa716271be6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:46.033208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-734da063-c26a-48f7-933d-efa716271be6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.159239 Aug 02 09:10:46.033789 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 307/606] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:45 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:46.091484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:46.092168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:46.102152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:46.102865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:46.103505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:46.103942 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:46.241838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:46.250350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:46.251911 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:46.253262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b19366a6-a6d8-4a81-9b35-64a9190f9434 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.165656 Aug 02 09:10:46.254097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 300/607] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:46 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:46.814531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-560cc32e-1a3f-4d35-af7a-599e95b25229 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:46.815350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-560cc32e-1a3f-4d35-af7a-599e95b25229 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:46.822485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-560cc32e-1a3f-4d35-af7a-599e95b25229 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:46.823186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-560cc32e-1a3f-4d35-af7a-599e95b25229 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:46.823985 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-560cc32e-1a3f-4d35-af7a-599e95b25229 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:46.824424 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-560cc32e-1a3f-4d35-af7a-599e95b25229 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:46.896877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-560cc32e-1a3f-4d35-af7a-599e95b25229 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:46.904600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-560cc32e-1a3f-4d35-af7a-599e95b25229 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1246 microversion: 2.1 time: 0.094323 Aug 02 09:10:46.905285 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 308/608] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:46 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:47.055257 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-dc23c7d8-cf44-45bc-9352-2d216f600fb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:47.055885 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-dc23c7d8-cf44-45bc-9352-2d216f600fb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:47.062159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dc23c7d8-cf44-45bc-9352-2d216f600fb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:47.063507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dc23c7d8-cf44-45bc-9352-2d216f600fb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:47.063507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dc23c7d8-cf44-45bc-9352-2d216f600fb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:47.063797 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dc23c7d8-cf44-45bc-9352-2d216f600fb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:47.198328 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-dc23c7d8-cf44-45bc-9352-2d216f600fb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:47.206114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-dc23c7d8-cf44-45bc-9352-2d216f600fb2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.155166 Aug 02 09:10:47.206683 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 301/609] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:47 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:47.275652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:47.276361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:47.282647 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:47.283091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:47.283859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:47.284288 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:47.422129 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:47.430851 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:47.432368 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:47.433529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-517004db-68f9-4a6c-a804-7ebda252c2e4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.161829 Aug 02 09:10:47.434118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 309/610] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:47 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:47.925627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6a78590e-e590-45c3-99ed-ccb94234d766 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:47.926264 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6a78590e-e590-45c3-99ed-ccb94234d766 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:47.933167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a78590e-e590-45c3-99ed-ccb94234d766 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:47.933618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a78590e-e590-45c3-99ed-ccb94234d766 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:47.934440 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a78590e-e590-45c3-99ed-ccb94234d766 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:47.934878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a78590e-e590-45c3-99ed-ccb94234d766 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:48.000027 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6a78590e-e590-45c3-99ed-ccb94234d766 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:48.007382 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6a78590e-e590-45c3-99ed-ccb94234d766 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1246 microversion: 2.1 time: 0.085614 Aug 02 09:10:48.007946 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 302/611] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:47 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:48.227389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-681cc3d2-ad81-49ed-a0c3-8eb6ebecf368 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:48.227940 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-681cc3d2-ad81-49ed-a0c3-8eb6ebecf368 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:48.234539 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-681cc3d2-ad81-49ed-a0c3-8eb6ebecf368 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:48.234975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-681cc3d2-ad81-49ed-a0c3-8eb6ebecf368 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:48.235728 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-681cc3d2-ad81-49ed-a0c3-8eb6ebecf368 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:48.236151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-681cc3d2-ad81-49ed-a0c3-8eb6ebecf368 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:48.374421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-681cc3d2-ad81-49ed-a0c3-8eb6ebecf368 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:48.382566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-681cc3d2-ad81-49ed-a0c3-8eb6ebecf368 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.159169 Aug 02 09:10:48.383137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 310/612] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:48 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:48.456579 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:48.457181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:48.463763 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:48.464206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:48.464952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:48.465380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:48.469437 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:48.603480 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:48.611327 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:48.612852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:48.614018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a90c97dc-4faf-4bd8-8a57-6bc62ac0a4da tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.161291 Aug 02 09:10:48.615087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 303/613] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:48 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:49.027943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6149de6b-3120-4c3e-bc7e-705264a0250a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:49.028472 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6149de6b-3120-4c3e-bc7e-705264a0250a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:49.030475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:49.035211 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6149de6b-3120-4c3e-bc7e-705264a0250a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:49.035658 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6149de6b-3120-4c3e-bc7e-705264a0250a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:49.036925 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6149de6b-3120-4c3e-bc7e-705264a0250a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:49.037363 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6149de6b-3120-4c3e-bc7e-705264a0250a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:49.102412 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6149de6b-3120-4c3e-bc7e-705264a0250a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:49.109837 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6149de6b-3120-4c3e-bc7e-705264a0250a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1246 microversion: 2.1 time: 0.085812 Aug 02 09:10:49.110429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 311/614] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:49 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:49.404326 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4f366aa0-42a9-4bdc-a92c-c612cabcb630 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:49.404953 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4f366aa0-42a9-4bdc-a92c-c612cabcb630 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:49.411084 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f366aa0-42a9-4bdc-a92c-c612cabcb630 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:49.412140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f366aa0-42a9-4bdc-a92c-c612cabcb630 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:49.412907 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f366aa0-42a9-4bdc-a92c-c612cabcb630 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:49.413332 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4f366aa0-42a9-4bdc-a92c-c612cabcb630 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:49.545059 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4f366aa0-42a9-4bdc-a92c-c612cabcb630 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:49.552701 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4f366aa0-42a9-4bdc-a92c-c612cabcb630 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.152193 Aug 02 09:10:49.553255 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 304/615] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:49 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:49.637667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:49.638273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:49.645077 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:49.645519 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:49.646332 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:49.646765 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:49.779472 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:49.788239 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:49.789728 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:49.790894 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c69e7625-17a1-4e7d-88c2-31f1847b79a8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.157546 Aug 02 09:10:49.791492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 312/616] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:49 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:50.131176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-44472c3e-d135-4073-8549-a17881c0a548 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:50.131782 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-44472c3e-d135-4073-8549-a17881c0a548 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:50.137878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-44472c3e-d135-4073-8549-a17881c0a548 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:50.138353 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-44472c3e-d135-4073-8549-a17881c0a548 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:50.139129 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-44472c3e-d135-4073-8549-a17881c0a548 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:50.139734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-44472c3e-d135-4073-8549-a17881c0a548 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:50.204999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-44472c3e-d135-4073-8549-a17881c0a548 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:50.213018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-44472c3e-d135-4073-8549-a17881c0a548 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1246 microversion: 2.1 time: 0.085740 Aug 02 09:10:50.213581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 305/617] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:50 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:50.574643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d494dbe1-7a52-41cb-8b1f-02a1a4c518c5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:50.575261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d494dbe1-7a52-41cb-8b1f-02a1a4c518c5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:50.581557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d494dbe1-7a52-41cb-8b1f-02a1a4c518c5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:50.582039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d494dbe1-7a52-41cb-8b1f-02a1a4c518c5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:50.582806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d494dbe1-7a52-41cb-8b1f-02a1a4c518c5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:50.583237 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d494dbe1-7a52-41cb-8b1f-02a1a4c518c5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:50.721157 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d494dbe1-7a52-41cb-8b1f-02a1a4c518c5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:50.725343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:50.729799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d494dbe1-7a52-41cb-8b1f-02a1a4c518c5 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.159428 Aug 02 09:10:50.730595 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 313/618] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:50 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:50.813971 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:50.814507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:50.821581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:50.822068 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:50.823126 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:50.823556 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:50.959051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:50.966895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:50.968384 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:50.969553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2a219513-944e-4a96-a217-6d518443d9c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.159747 Aug 02 09:10:50.970143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 306/619] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:50 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:51.236381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-05d07f39-cc77-4fb4-8c0c-56e484eef0e0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:51.236381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-05d07f39-cc77-4fb4-8c0c-56e484eef0e0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:51.241853 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05d07f39-cc77-4fb4-8c0c-56e484eef0e0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:51.242325 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05d07f39-cc77-4fb4-8c0c-56e484eef0e0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:51.243085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05d07f39-cc77-4fb4-8c0c-56e484eef0e0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:51.243514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05d07f39-cc77-4fb4-8c0c-56e484eef0e0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:51.306554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-05d07f39-cc77-4fb4-8c0c-56e484eef0e0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:51.314402 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-05d07f39-cc77-4fb4-8c0c-56e484eef0e0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1246 microversion: 2.1 time: 0.083799 Aug 02 09:10:51.314966 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 314/620] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:51 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:51.768200 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d3b1a6c3-c803-4cc1-bc3d-8dc57b3f56d3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:51.768723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d3b1a6c3-c803-4cc1-bc3d-8dc57b3f56d3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:51.776398 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d3b1a6c3-c803-4cc1-bc3d-8dc57b3f56d3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:51.777191 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d3b1a6c3-c803-4cc1-bc3d-8dc57b3f56d3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:51.777798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d3b1a6c3-c803-4cc1-bc3d-8dc57b3f56d3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:51.778454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d3b1a6c3-c803-4cc1-bc3d-8dc57b3f56d3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:51.937081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d3b1a6c3-c803-4cc1-bc3d-8dc57b3f56d3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:51.948360 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d3b1a6c3-c803-4cc1-bc3d-8dc57b3f56d3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.183955 Aug 02 09:10:51.948953 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 307/621] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:51 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:51.998735 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:51.999396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:52.005290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:52.005742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:52.006547 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:52.006986 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:52.157722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:52.175675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:52.177681 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:52.179108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7889d600-e167-40b2-8173-c0d5ba3b14cd tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.185405 Aug 02 09:10:52.179830 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 315/622] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:51 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:52.337817 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7e2cd756-391a-4b40-ad2e-944bad6d49ce tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:52.338395 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7e2cd756-391a-4b40-ad2e-944bad6d49ce tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:52.344562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e2cd756-391a-4b40-ad2e-944bad6d49ce tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:52.345092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e2cd756-391a-4b40-ad2e-944bad6d49ce tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:52.345852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e2cd756-391a-4b40-ad2e-944bad6d49ce tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:52.346365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e2cd756-391a-4b40-ad2e-944bad6d49ce tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:52.414855 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7e2cd756-391a-4b40-ad2e-944bad6d49ce tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:52.422799 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7e2cd756-391a-4b40-ad2e-944bad6d49ce tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1246 microversion: 2.1 time: 0.088895 Aug 02 09:10:52.423508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 308/623] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:52 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:52.971035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-077a6689-c1b3-4365-ac34-861f5e2a114d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:52.971662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-077a6689-c1b3-4365-ac34-861f5e2a114d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:52.978125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-077a6689-c1b3-4365-ac34-861f5e2a114d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:52.978576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-077a6689-c1b3-4365-ac34-861f5e2a114d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:52.979377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-077a6689-c1b3-4365-ac34-861f5e2a114d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:52.979866 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-077a6689-c1b3-4365-ac34-861f5e2a114d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:53.120237 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-077a6689-c1b3-4365-ac34-861f5e2a114d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:53.127860 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-077a6689-c1b3-4365-ac34-861f5e2a114d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1513 microversion: 2.1 time: 0.160956 Aug 02 09:10:53.128427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 316/624] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:52 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:53.203842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:53.204513 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:53.211773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:53.212393 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:53.213006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:53.213442 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:53.446799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-eafd9f8b-91bf-4a35-96b4-ade46383f21d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:53.447661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-eafd9f8b-91bf-4a35-96b4-ade46383f21d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:53.453795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eafd9f8b-91bf-4a35-96b4-ade46383f21d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:53.454456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eafd9f8b-91bf-4a35-96b4-ade46383f21d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:53.455357 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eafd9f8b-91bf-4a35-96b4-ade46383f21d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:53.455652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eafd9f8b-91bf-4a35-96b4-ade46383f21d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:53.457736 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:53.467993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:53.469738 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:53.470947 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-374dedea-f7e4-4650-9304-20e4806acf50 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.271095 Aug 02 09:10:53.472025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 309/625] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:53 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:53.533202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-eafd9f8b-91bf-4a35-96b4-ade46383f21d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:53.542328 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-eafd9f8b-91bf-4a35-96b4-ade46383f21d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1246 microversion: 2.1 time: 0.102008 Aug 02 09:10:53.543130 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 317/626] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:53 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:53.892298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-08ab3f19-b7b2-4ea9-8cfd-27a6fd68ae75 req-7c70aab3-d2d3-484d-8912-e4032e3205f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df72120-5785-40dc-94eb-4fb66b4a8fc0", "name": "network-vif-deleted", "tag": "4b8a4403-3f1c-4e67-ba1b-5cb012dccd2f"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:53.902871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-08ab3f19-b7b2-4ea9-8cfd-27a6fd68ae75 req-7c70aab3-d2d3-484d-8912-e4032e3205f3 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:53.903391 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-08ab3f19-b7b2-4ea9-8cfd-27a6fd68ae75 req-7c70aab3-d2d3-484d-8912-e4032e3205f3 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:53.915508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-08ab3f19-b7b2-4ea9-8cfd-27a6fd68ae75 req-7c70aab3-d2d3-484d-8912-e4032e3205f3 service nova] Creating event network-vif-deleted:4b8a4403-3f1c-4e67-ba1b-5cb012dccd2f for instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 on hv-cinder-84713 Aug 02 09:10:53.920647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-08ab3f19-b7b2-4ea9-8cfd-27a6fd68ae75 req-7c70aab3-d2d3-484d-8912-e4032e3205f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032370 Aug 02 09:10:53.921234 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 310/627] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:54.149349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:54.150113 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:54.156536 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:54.156991 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:54.157779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:54.158329 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:54.190540 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:54.190985 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:54.191429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lazy-loading 'fault' on Instance uuid 6df72120-5785-40dc-94eb-4fb66b4a8fc0 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:54.232969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:54.240537 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-69d04e8b-4d6a-42e1-9f8c-a1cb530b0eec tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1308 microversion: 2.1 time: 0.095724 Aug 02 09:10:54.241103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 318/628] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:54 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:54.495597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:54.496312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:54.499393 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:54.504414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:54.504864 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:54.505646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:54.506111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:54.564220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5af97af8-2b70-42df-8550-79bb1a3fa47e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:54.564819 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5af97af8-2b70-42df-8550-79bb1a3fa47e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:54.571039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5af97af8-2b70-42df-8550-79bb1a3fa47e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:54.571493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5af97af8-2b70-42df-8550-79bb1a3fa47e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:54.572527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5af97af8-2b70-42df-8550-79bb1a3fa47e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:54.572963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5af97af8-2b70-42df-8550-79bb1a3fa47e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:54.639578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5af97af8-2b70-42df-8550-79bb1a3fa47e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:54.647507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5af97af8-2b70-42df-8550-79bb1a3fa47e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1294 microversion: 2.1 time: 0.087222 Aug 02 09:10:54.649603 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 319/629] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:54 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:54.651567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:54.671832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:54.674369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:54.675545 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4ad6904d-3767-4402-aeef-c8f53a0cc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.184315 Aug 02 09:10:54.676108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 311/630] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:54 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:55.262718 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:55.263325 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:55.270961 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:55.271410 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:55.272186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:55.272621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:55.305560 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:55.306040 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:55.306492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lazy-loading 'fault' on Instance uuid 6df72120-5785-40dc-94eb-4fb66b4a8fc0 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:10:55.355052 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:55.365550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3273b1a8-05e8-4602-9637-e9acc59dc01d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 200 len: 1308 microversion: 2.1 time: 0.106624 Aug 02 09:10:55.366201 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 320/631] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:55 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:55.676642 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-408a874a-62af-40f8-bd75-cd5a4da8daf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:55.677569 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-408a874a-62af-40f8-bd75-cd5a4da8daf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:55.684793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-408a874a-62af-40f8-bd75-cd5a4da8daf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:55.685325 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-408a874a-62af-40f8-bd75-cd5a4da8daf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:55.686516 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-408a874a-62af-40f8-bd75-cd5a4da8daf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:55.687194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-408a874a-62af-40f8-bd75-cd5a4da8daf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:55.700181 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:55.701096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:55.703483 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:55.704513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=6 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:55.714800 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:55.715885 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:55.717652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:55.718588 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:55.791281 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=6 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:55.808778 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-408a874a-62af-40f8-bd75-cd5a4da8daf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:55.820635 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-408a874a-62af-40f8-bd75-cd5a4da8daf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1302 microversion: 2.1 time: 0.148387 Aug 02 09:10:55.823957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 312/632] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:55 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:55.941140 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:55.962585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:55.966026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:55.967525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b903c19d-ff03-411a-bcf3-036f9dcfecd6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.272323 Aug 02 09:10:55.982580 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 321/633] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:55 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:10:56.406752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:56.406752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: 6df72120-5785-40dc-94eb-4fb66b4a8fc0] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:56.415467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:56.415932 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:56.416747 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:56.417390 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:56.433403 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] HTTP exception thrown: Instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 could not be found. Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Request method failure captured: Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 HTTP/1.1 Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OlsGpvQKC_cyqCq4efJmZXc9yGI7yC8AuzdjrmTsMJS2us9FJYMj6sAmVjBM5-MsHLufBmxYYXSYfnizDxFmmUC_D14tHZmqJLF8LiZbFUlNh8XlSbtsEr4q8NAXAwdsde3_6WxljbviG-xdzK6Fri13j4_Tb-Q6EMoHi3M2eOz5fs Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 76cc762f121e46c096aaca327258258c Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1516523254 Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:10:56.435138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/76cc762f121e46c096aaca327258258c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/76cc762f121e46c096aaca327258258c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_76cc762f121e46c096aaca327258258c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/76cc762f121e46c096aaca327258258c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-VolumesSnapshotTestJSON-1516523254 Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 76cc762f121e46c096aaca327258258c Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1516523254 Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-VolumesSnapshotTestJSON-1516523254-project Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: f1fd384cbf4943368ee57e868c37d92c Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-VolumesSnapshotTestJSON-1516523254-project Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 could not be found. Aug 02 09:10:56.436795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '6df72120-5785-40dc-94eb-4fb66b4a8fc0'} Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 could not be found. Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:56.437696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 could not be found. Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 could not be found. Aug 02 09:10:56.439014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:10:56.442140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Returning 404 to user: Instance 6df72120-5785-40dc-94eb-4fb66b4a8fc0 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:56.443181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b09e666b-8368-4310-97c5-fd3cccd0eb8d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0" status: 404 len: 111 microversion: 2.1 time: 0.044810 Aug 02 09:10:56.443912 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 313/634] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:56 2022] GET /compute/v2.1/servers/6df72120-5785-40dc-94eb-4fb66b4a8fc0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:56.844807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5e2c815e-ccf0-4fa8-a180-d7ec47be7aca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:56.846897 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5e2c815e-ccf0-4fa8-a180-d7ec47be7aca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:56.855261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5e2c815e-ccf0-4fa8-a180-d7ec47be7aca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:56.856005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5e2c815e-ccf0-4fa8-a180-d7ec47be7aca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:56.857162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5e2c815e-ccf0-4fa8-a180-d7ec47be7aca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:56.857813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5e2c815e-ccf0-4fa8-a180-d7ec47be7aca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:56.955977 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5e2c815e-ccf0-4fa8-a180-d7ec47be7aca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:56.966410 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5e2c815e-ccf0-4fa8-a180-d7ec47be7aca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1300 microversion: 2.1 time: 0.124922 Aug 02 09:10:56.967702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 322/635] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:56 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:56.993260 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:56.993913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:57.007414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:57.008138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:57.009099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:57.010016 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:57.260748 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:57.269580 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:57.272641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:57.274186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9958e87f-e37d-4aa3-9468-f15d11e19a5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.285158 Aug 02 09:10:57.275243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 314/636] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:56 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:57.993035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0084663c-cf45-4b47-9e81-35bb7ac5e414 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:57.993993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0084663c-cf45-4b47-9e81-35bb7ac5e414 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:58.009952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0084663c-cf45-4b47-9e81-35bb7ac5e414 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:58.010688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0084663c-cf45-4b47-9e81-35bb7ac5e414 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:58.015306 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0084663c-cf45-4b47-9e81-35bb7ac5e414 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:58.016146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0084663c-cf45-4b47-9e81-35bb7ac5e414 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:58.204790 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0084663c-cf45-4b47-9e81-35bb7ac5e414 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:58.215742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0084663c-cf45-4b47-9e81-35bb7ac5e414 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.228894 Aug 02 09:10:58.216925 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 323/637] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:57 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:58.303156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:58.304681 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:58.311286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:58.312287 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:58.313293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:58.313931 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:58.463505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:58.473140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:58.475090 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:58.476482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5b44107b-01f2-4110-9d0b-3b33e1b0b792 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.179053 Aug 02 09:10:58.477220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 315/638] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:58 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:59.241731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6e59a2c2-2836-483b-976a-427694757f74 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:59.243281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6e59a2c2-2836-483b-976a-427694757f74 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:59.252070 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e59a2c2-2836-483b-976a-427694757f74 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:59.252718 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e59a2c2-2836-483b-976a-427694757f74 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:59.253731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e59a2c2-2836-483b-976a-427694757f74 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:59.254519 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e59a2c2-2836-483b-976a-427694757f74 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:59.417095 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6e59a2c2-2836-483b-976a-427694757f74 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.425874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6e59a2c2-2836-483b-976a-427694757f74 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.191223 Aug 02 09:10:59.439633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 324/639] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:59 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:59.502358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:59.503668 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:59.512422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:59.513259 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:59.514650 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:59.515299 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:59.670028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.678683 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.680457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.681815 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6f24c6d3-8c06-49ae-9f10-5ad6bf9efbc5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.184557 Aug 02 09:10:59.682565 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 316/640] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:59 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:00.447477 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1db1bb8f-ad44-45a3-bf9d-72f289aff637 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:00.448179 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1db1bb8f-ad44-45a3-bf9d-72f289aff637 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:00.454969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1db1bb8f-ad44-45a3-bf9d-72f289aff637 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.455664 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1db1bb8f-ad44-45a3-bf9d-72f289aff637 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.456599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1db1bb8f-ad44-45a3-bf9d-72f289aff637 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.457716 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1db1bb8f-ad44-45a3-bf9d-72f289aff637 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.609954 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1db1bb8f-ad44-45a3-bf9d-72f289aff637 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:00.617713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1db1bb8f-ad44-45a3-bf9d-72f289aff637 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.174635 Aug 02 09:11:00.618320 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 325/641] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:00 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:00.712819 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:00.713434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:00.720495 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.721165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.722215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.722938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.867551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:00.877085 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:00.878667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:00.880381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-49eb43a2-602e-4b2a-ae80-05c6c202342e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.171693 Aug 02 09:11:00.885918 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 317/642] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:00 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:01.649834 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-772481de-f442-44bd-b963-6ab588855900 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:01.650510 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-772481de-f442-44bd-b963-6ab588855900 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:01.669226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-772481de-f442-44bd-b963-6ab588855900 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:01.669677 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-772481de-f442-44bd-b963-6ab588855900 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:01.670573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-772481de-f442-44bd-b963-6ab588855900 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:01.671000 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-772481de-f442-44bd-b963-6ab588855900 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:01.805242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-772481de-f442-44bd-b963-6ab588855900 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:01.813382 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-772481de-f442-44bd-b963-6ab588855900 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.177061 Aug 02 09:11:01.830760 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 326/643] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:01 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:01.904773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:01.905521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:01.912995 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:01.913529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:01.914412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:01.914914 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.076997 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:02.086428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:02.087931 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:02.089093 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ba2ce015-5109-4ae7-ac8c-aa117a04754d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.188833 Aug 02 09:11:02.089685 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 318/644] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:01 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:02.839322 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-552d3c43-9ef7-4a52-8ca6-aa9f07a2200d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:02.840032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-552d3c43-9ef7-4a52-8ca6-aa9f07a2200d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:02.849518 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-552d3c43-9ef7-4a52-8ca6-aa9f07a2200d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.849719 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-552d3c43-9ef7-4a52-8ca6-aa9f07a2200d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.850530 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-552d3c43-9ef7-4a52-8ca6-aa9f07a2200d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.850958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-552d3c43-9ef7-4a52-8ca6-aa9f07a2200d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:03.007555 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-552d3c43-9ef7-4a52-8ca6-aa9f07a2200d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.027700 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-552d3c43-9ef7-4a52-8ca6-aa9f07a2200d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.192047 Aug 02 09:11:03.028867 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 327/645] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:02 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:03.113591 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:03.115430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:03.127433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:03.128137 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:03.129125 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:03.131131 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:03.413962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.421874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.423419 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.424587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-be68384f-cba4-4527-a5a2-cfad2ba4079f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.315574 Aug 02 09:11:03.425219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 319/646] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:03 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:03.889599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-7d90e29f-0ee7-4e1a-9676-0e6ccfb3f25e req-699022d4-ffd1-4576-a2a6-c5be97a88dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc844d0-e603-4cbd-9196-ef78031daa43", "tag": "95b4f3b0-a468-42f5-ae4f-42c268d708d9"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:03.899829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-7d90e29f-0ee7-4e1a-9676-0e6ccfb3f25e req-699022d4-ffd1-4576-a2a6-c5be97a88dc9 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:03.900276 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-7d90e29f-0ee7-4e1a-9676-0e6ccfb3f25e req-699022d4-ffd1-4576-a2a6-c5be97a88dc9 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:03.912108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-7d90e29f-0ee7-4e1a-9676-0e6ccfb3f25e req-699022d4-ffd1-4576-a2a6-c5be97a88dc9 service nova] Creating event network-changed:95b4f3b0-a468-42f5-ae4f-42c268d708d9 for instance dbc844d0-e603-4cbd-9196-ef78031daa43 on hv-cinder-84713 Aug 02 09:11:03.917299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-7d90e29f-0ee7-4e1a-9676-0e6ccfb3f25e req-699022d4-ffd1-4576-a2a6-c5be97a88dc9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031464 Aug 02 09:11:03.917897 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 328/647] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:04.049058 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-24bd2fc1-f57c-4d3f-88cb-f63ffe1d2f10 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:04.049675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-24bd2fc1-f57c-4d3f-88cb-f63ffe1d2f10 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:04.056612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-24bd2fc1-f57c-4d3f-88cb-f63ffe1d2f10 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:04.057116 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-24bd2fc1-f57c-4d3f-88cb-f63ffe1d2f10 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:04.057945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-24bd2fc1-f57c-4d3f-88cb-f63ffe1d2f10 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:04.061922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-24bd2fc1-f57c-4d3f-88cb-f63ffe1d2f10 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:04.193538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-24bd2fc1-f57c-4d3f-88cb-f63ffe1d2f10 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:04.201299 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-24bd2fc1-f57c-4d3f-88cb-f63ffe1d2f10 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.156214 Aug 02 09:11:04.201855 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 320/648] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:04 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:04.449408 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:04.450133 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:04.456598 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:04.457051 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:04.458416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:04.458854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:04.597084 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:04.605118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:04.606666 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:04.607821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5c6bc4e1-49fd-4186-922c-fe1448b1146a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.163026 Aug 02 09:11:04.608512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 329/649] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:04 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:05.221824 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-067b0272-3239-49fd-b763-7465c6eef937 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:05.222473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-067b0272-3239-49fd-b763-7465c6eef937 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:05.229736 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-067b0272-3239-49fd-b763-7465c6eef937 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.230240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-067b0272-3239-49fd-b763-7465c6eef937 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.231002 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-067b0272-3239-49fd-b763-7465c6eef937 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.231430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-067b0272-3239-49fd-b763-7465c6eef937 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.235297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:05.372000 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-067b0272-3239-49fd-b763-7465c6eef937 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.380396 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-067b0272-3239-49fd-b763-7465c6eef937 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.162433 Aug 02 09:11:05.380962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 321/650] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:05 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:05.633106 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:05.633736 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:05.640506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.640955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.641718 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.642181 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.660596 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:05.777504 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.786207 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.787714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.788878 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-07182add-46a2-492a-80be-2914d6aed65d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.160213 Aug 02 09:11:05.789441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 330/651] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:05 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:06.402143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3ae9c631-4461-43f7-bdb7-603156a6c54d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:06.403332 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3ae9c631-4461-43f7-bdb7-603156a6c54d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:06.411408 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3ae9c631-4461-43f7-bdb7-603156a6c54d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.415600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3ae9c631-4461-43f7-bdb7-603156a6c54d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.416579 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3ae9c631-4461-43f7-bdb7-603156a6c54d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.417215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3ae9c631-4461-43f7-bdb7-603156a6c54d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.570598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3ae9c631-4461-43f7-bdb7-603156a6c54d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:06.579605 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3ae9c631-4461-43f7-bdb7-603156a6c54d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.181355 Aug 02 09:11:06.581064 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 322/652] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:06 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:06.813058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:06.813673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:06.825101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.825554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.828347 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.833542 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.025094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:07.034676 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:07.036212 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:07.037364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-16761073-a3a6-4272-a05d-f1ef935c29c3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.228496 Aug 02 09:11:07.038138 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 331/653] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:06 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:07.600927 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7c022157-0c77-4cba-a778-a112321a48aa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:07.601522 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7c022157-0c77-4cba-a778-a112321a48aa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:07.609680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c022157-0c77-4cba-a778-a112321a48aa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.610250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c022157-0c77-4cba-a778-a112321a48aa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.611100 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c022157-0c77-4cba-a778-a112321a48aa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.611745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c022157-0c77-4cba-a778-a112321a48aa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.763827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7c022157-0c77-4cba-a778-a112321a48aa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:07.775295 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7c022157-0c77-4cba-a778-a112321a48aa tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.178048 Aug 02 09:11:07.790766 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 323/654] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:07 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:07.908637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-64cf844a-383e-46bf-bf1e-54d79ecc508f req-9a0a583f-9f3b-407a-b29d-bebbcf3b4858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c248147-71ed-4f5f-89cc-8ca12974efb4", "name": "network-vif-plugged", "status": "completed", "tag": "27491509-00ef-451e-b2ac-f08e653e8310"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:07.920537 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-64cf844a-383e-46bf-bf1e-54d79ecc508f req-9a0a583f-9f3b-407a-b29d-bebbcf3b4858 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.920978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-64cf844a-383e-46bf-bf1e-54d79ecc508f req-9a0a583f-9f3b-407a-b29d-bebbcf3b4858 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.936365 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-64cf844a-383e-46bf-bf1e-54d79ecc508f req-9a0a583f-9f3b-407a-b29d-bebbcf3b4858 service nova] Creating event network-vif-plugged:27491509-00ef-451e-b2ac-f08e653e8310 for instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 on hv-cinder-84713 Aug 02 09:11:07.942601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-64cf844a-383e-46bf-bf1e-54d79ecc508f req-9a0a583f-9f3b-407a-b29d-bebbcf3b4858 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037810 Aug 02 09:11:07.943731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 332/655] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:08.060298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:08.061186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:08.070087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:08.070833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:08.072105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:08.072801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:08.217381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:08.226584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:08.228132 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:08.229414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f1f88136-1de5-47c5-a7b6-e128eea99030 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.172977 Aug 02 09:11:08.244962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 324/656] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:08 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:08.797554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cbf5e3e9-1392-49ed-b2bc-50c0a41a36b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:08.798263 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cbf5e3e9-1392-49ed-b2bc-50c0a41a36b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:08.805576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cbf5e3e9-1392-49ed-b2bc-50c0a41a36b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:08.806344 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cbf5e3e9-1392-49ed-b2bc-50c0a41a36b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:08.807418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cbf5e3e9-1392-49ed-b2bc-50c0a41a36b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:08.808251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cbf5e3e9-1392-49ed-b2bc-50c0a41a36b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:08.993948 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-cbf5e3e9-1392-49ed-b2bc-50c0a41a36b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.020732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cbf5e3e9-1392-49ed-b2bc-50c0a41a36b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.226613 Aug 02 09:11:09.021228 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 333/657] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:08 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:09.252986 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:09.253686 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:09.265624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.266301 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.267023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.268002 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.445148 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.455529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.457266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.459376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6fd51aad-77ab-4b2d-939d-2498636213a1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.210601 Aug 02 09:11:09.459976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 325/658] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:09 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:10.041931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3038c784-00c5-4c2e-b99f-ecfadf077ffb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:10.043324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3038c784-00c5-4c2e-b99f-ecfadf077ffb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:10.050981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3038c784-00c5-4c2e-b99f-ecfadf077ffb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:10.051686 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3038c784-00c5-4c2e-b99f-ecfadf077ffb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:10.052647 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3038c784-00c5-4c2e-b99f-ecfadf077ffb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:10.055137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3038c784-00c5-4c2e-b99f-ecfadf077ffb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:10.198181 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3038c784-00c5-4c2e-b99f-ecfadf077ffb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:10.208583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3038c784-00c5-4c2e-b99f-ecfadf077ffb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.170558 Aug 02 09:11:10.209148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 334/659] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:10 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:10.489670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:10.490274 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:10.498549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:10.499211 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:10.499795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:10.500222 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:10.664079 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:10.673484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:10.675162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:10.677368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-60534618-c987-4b29-ae9f-958fdb39e007 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.192589 Aug 02 09:11:10.678028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 326/660] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:10 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:11.229142 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1dff1b47-a229-4552-9539-2fc81696aacf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:11.229748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1dff1b47-a229-4552-9539-2fc81696aacf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:11.236690 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1dff1b47-a229-4552-9539-2fc81696aacf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:11.237142 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1dff1b47-a229-4552-9539-2fc81696aacf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.238641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1dff1b47-a229-4552-9539-2fc81696aacf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:11.239248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1dff1b47-a229-4552-9539-2fc81696aacf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.436677 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1dff1b47-a229-4552-9539-2fc81696aacf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.449028 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1dff1b47-a229-4552-9539-2fc81696aacf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.223465 Aug 02 09:11:11.450095 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 335/661] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:11 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:11.701588 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:11.702405 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:11.711165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:11.711932 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.712993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:11.713630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.897245 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.906496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.908303 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.909635 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-730d3b48-773c-4294-a37b-745cf401a160 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.212219 Aug 02 09:11:11.910929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 327/662] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:11 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:12.472200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dc6a128a-300a-48ad-a7f8-73b99be6a5b5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:12.473563 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-dc6a128a-300a-48ad-a7f8-73b99be6a5b5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:12.482452 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dc6a128a-300a-48ad-a7f8-73b99be6a5b5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.483760 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dc6a128a-300a-48ad-a7f8-73b99be6a5b5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.485289 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dc6a128a-300a-48ad-a7f8-73b99be6a5b5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.486289 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dc6a128a-300a-48ad-a7f8-73b99be6a5b5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.640074 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dc6a128a-300a-48ad-a7f8-73b99be6a5b5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:12.648969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dc6a128a-300a-48ad-a7f8-73b99be6a5b5 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.181849 Aug 02 09:11:12.650307 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 336/663] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:12 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:12.936998 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:12.937772 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:12.945823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.946632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.947468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.947991 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.101517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:13.110008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:13.111620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:13.112793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-77ccbdb6-f01f-407d-b6b0-644d2796de76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.179949 Aug 02 09:11:13.125904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 328/664] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:12 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:13.670847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-906caf66-f9f2-4405-baa0-70053f0b5c04 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:13.671459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-906caf66-f9f2-4405-baa0-70053f0b5c04 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:13.678509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-906caf66-f9f2-4405-baa0-70053f0b5c04 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.678966 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-906caf66-f9f2-4405-baa0-70053f0b5c04 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.679916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-906caf66-f9f2-4405-baa0-70053f0b5c04 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.680523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-906caf66-f9f2-4405-baa0-70053f0b5c04 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.820877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-906caf66-f9f2-4405-baa0-70053f0b5c04 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:13.830171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-906caf66-f9f2-4405-baa0-70053f0b5c04 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.163018 Aug 02 09:11:13.830973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 337/665] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:13 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:14.137992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:14.138606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:14.146167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:14.146167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.146945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:14.147384 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.284145 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.292498 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.294028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.295171 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7c98539c-8556-4424-87eb-14afd49fc50b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.161071 Aug 02 09:11:14.295839 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 329/666] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:14 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:14.852723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-58e49970-3989-4dca-816e-92cc547f394a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:14.853342 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-58e49970-3989-4dca-816e-92cc547f394a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:14.860086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58e49970-3989-4dca-816e-92cc547f394a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:14.860531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58e49970-3989-4dca-816e-92cc547f394a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.861321 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58e49970-3989-4dca-816e-92cc547f394a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:14.861755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58e49970-3989-4dca-816e-92cc547f394a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.989599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-58e49970-3989-4dca-816e-92cc547f394a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.997090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-58e49970-3989-4dca-816e-92cc547f394a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.148938 Aug 02 09:11:14.997671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 338/667] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:14 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:15.319861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:15.320438 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:15.327100 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.327538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.328287 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.328713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.466083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:15.474002 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:15.475514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:15.476670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-200414e4-7b11-4339-bf40-205e4be03500 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.161391 Aug 02 09:11:15.477222 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 330/668] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:15 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:16.017820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4f90f866-4295-489b-a2c1-728e7cc71877 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:16.018800 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4f90f866-4295-489b-a2c1-728e7cc71877 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:16.025411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4f90f866-4295-489b-a2c1-728e7cc71877 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.025911 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4f90f866-4295-489b-a2c1-728e7cc71877 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.026694 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4f90f866-4295-489b-a2c1-728e7cc71877 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.027130 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4f90f866-4295-489b-a2c1-728e7cc71877 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.163659 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4f90f866-4295-489b-a2c1-728e7cc71877 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:16.171187 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4f90f866-4295-489b-a2c1-728e7cc71877 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.157239 Aug 02 09:11:16.171778 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 339/669] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:16 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:16.500989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:16.501559 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:16.508816 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.509263 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.510055 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.510531 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.537440 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1329028895", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "networks": [{"uuid": "d5afca6f-34e9-4113-b8e9-ded5c8c20b76"}]}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:16.789650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] validate_networks() for [('d5afca6f-34e9-4113-b8e9-ded5c8c20b76', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:11:16.825039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:16.828420 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:16.829929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:16.831278 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5e44ff34-4bb6-445c-8542-3110046f776e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.334783 Aug 02 09:11:16.831810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 331/670] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:16 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:17.149082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:11:17.149540 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:11:17.149981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:11:17.150383 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:11:17.150815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:11:17.159634 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.160074 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.160885 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.165980 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.178060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Getting quotas for project 76cc762f121e46c096aaca327258258c. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:17.181935 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Getting quotas for user f1fd384cbf4943368ee57e868c37d92c and project 76cc762f121e46c096aaca327258258c. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:17.192341 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f72e49a7-0a81-44aa-a05c-08a33484080e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:17.192947 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f72e49a7-0a81-44aa-a05c-08a33484080e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:17.193994 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:11:17.196519 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:11:17.201697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f72e49a7-0a81-44aa-a05c-08a33484080e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.202124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f72e49a7-0a81-44aa-a05c-08a33484080e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.202941 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f72e49a7-0a81-44aa-a05c-08a33484080e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.203977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f72e49a7-0a81-44aa-a05c-08a33484080e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.339215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f72e49a7-0a81-44aa-a05c-08a33484080e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:17.346618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f72e49a7-0a81-44aa-a05c-08a33484080e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.158770 Aug 02 09:11:17.347396 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 332/671] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:17 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:17.365103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-67bd3d79-a6a0-4197-b47b-fba9c5e3d406 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831650 Aug 02 09:11:17.365753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 340/672] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:11:17.376311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c299d1dd-0cf9-4ffc-a35d-5b5965843c56 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:17.379179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c299d1dd-0cf9-4ffc-a35d-5b5965843c56 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:17.430362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c299d1dd-0cf9-4ffc-a35d-5b5965843c56 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:17.437142 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c299d1dd-0cf9-4ffc-a35d-5b5965843c56 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1219 microversion: 2.1 time: 0.064659 Aug 02 09:11:17.437723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 333/673] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:17 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:17.855721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:17.856342 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:17.862595 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.863035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.865444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.865444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.994144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:18.002494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:18.004516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:18.006767 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fa4c627e-79b1-4a9d-b532-a2e329385262 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1742 microversion: 2.20 time: 0.154077 Aug 02 09:11:18.007615 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 341/674] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:17 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:18.368323 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-671536ed-67a9-4f87-a166-e6bdf21d2683 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:18.368930 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-671536ed-67a9-4f87-a166-e6bdf21d2683 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:18.375947 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-671536ed-67a9-4f87-a166-e6bdf21d2683 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.376428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-671536ed-67a9-4f87-a166-e6bdf21d2683 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.377182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-671536ed-67a9-4f87-a166-e6bdf21d2683 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.377613 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-671536ed-67a9-4f87-a166-e6bdf21d2683 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.458755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a34fb45c-379a-4693-81e7-4dda6b733fa3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:18.459847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a34fb45c-379a-4693-81e7-4dda6b733fa3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:18.467085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a34fb45c-379a-4693-81e7-4dda6b733fa3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.467621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a34fb45c-379a-4693-81e7-4dda6b733fa3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.468505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a34fb45c-379a-4693-81e7-4dda6b733fa3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.469039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a34fb45c-379a-4693-81e7-4dda6b733fa3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.538664 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a34fb45c-379a-4693-81e7-4dda6b733fa3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:18.549437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a34fb45c-379a-4693-81e7-4dda6b733fa3 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1223 microversion: 2.1 time: 0.094314 Aug 02 09:11:18.549568 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 342/675] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:18 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:18.549668 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-671536ed-67a9-4f87-a166-e6bdf21d2683 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:18.569675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-671536ed-67a9-4f87-a166-e6bdf21d2683 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.205045 Aug 02 09:11:18.580164 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 334/676] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:18 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:19.030770 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:19.031468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:19.038759 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.039345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.040153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.040575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.227882 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.237452 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.239441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.241495 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-74d8ffb6-4267-46c8-8e00-13fcbe77b21e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.214266 Aug 02 09:11:19.254746 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 343/677] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:19 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:19.572376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-79248f08-2872-4ac0-99fb-b72948e80f60 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:19.576228 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-79248f08-2872-4ac0-99fb-b72948e80f60 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:19.579252 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79248f08-2872-4ac0-99fb-b72948e80f60 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.579883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79248f08-2872-4ac0-99fb-b72948e80f60 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.580925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79248f08-2872-4ac0-99fb-b72948e80f60 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.581505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79248f08-2872-4ac0-99fb-b72948e80f60 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.594267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-aa0c9314-cb93-4ef7-b218-fc7dc194a23c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:19.594998 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-aa0c9314-cb93-4ef7-b218-fc7dc194a23c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:19.619062 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa0c9314-cb93-4ef7-b218-fc7dc194a23c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.620909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa0c9314-cb93-4ef7-b218-fc7dc194a23c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.621922 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa0c9314-cb93-4ef7-b218-fc7dc194a23c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.623781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa0c9314-cb93-4ef7-b218-fc7dc194a23c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.661838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-79248f08-2872-4ac0-99fb-b72948e80f60 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.671253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-79248f08-2872-4ac0-99fb-b72948e80f60 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1271 microversion: 2.1 time: 0.103070 Aug 02 09:11:19.672491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 335/678] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:19 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:19.902594 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-aa0c9314-cb93-4ef7-b218-fc7dc194a23c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.927309 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-aa0c9314-cb93-4ef7-b218-fc7dc194a23c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.334314 Aug 02 09:11:19.929600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 344/679] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:19 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:20.270982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:20.271883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:20.287853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.290387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.292551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.294707 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.623223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.634758 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.636838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.638298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-79c81bf9-a619-440e-88fc-2623f1e2b3b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.371300 Aug 02 09:11:20.642239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 336/680] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:20 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:20.699556 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-bebb7125-2b4f-4bb8-8ee2-32871216dae8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:20.704947 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-bebb7125-2b4f-4bb8-8ee2-32871216dae8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:20.716888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:20.725389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bebb7125-2b4f-4bb8-8ee2-32871216dae8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.727081 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bebb7125-2b4f-4bb8-8ee2-32871216dae8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.728410 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bebb7125-2b4f-4bb8-8ee2-32871216dae8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.731693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bebb7125-2b4f-4bb8-8ee2-32871216dae8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.888154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bebb7125-2b4f-4bb8-8ee2-32871216dae8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.902218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-bebb7125-2b4f-4bb8-8ee2-32871216dae8 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1277 microversion: 2.1 time: 0.212388 Aug 02 09:11:20.919562 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 345/681] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:20 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:20.956370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-876d9688-5b6e-4093-82db-a1dedc543e47 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:20.957007 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-876d9688-5b6e-4093-82db-a1dedc543e47 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:20.963378 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-876d9688-5b6e-4093-82db-a1dedc543e47 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.964083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-876d9688-5b6e-4093-82db-a1dedc543e47 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.965301 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-876d9688-5b6e-4093-82db-a1dedc543e47 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.965914 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-876d9688-5b6e-4093-82db-a1dedc543e47 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.174714 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-876d9688-5b6e-4093-82db-a1dedc543e47 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.193433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-876d9688-5b6e-4093-82db-a1dedc543e47 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.240316 Aug 02 09:11:21.206838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 337/682] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:20 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:21.666342 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:21.667249 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:21.674993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.675748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.676894 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.677551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.866443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.880856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.883578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.885802 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7ab8a0a7-2660-4485-abe0-7f7d325f05b0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.225263 Aug 02 09:11:21.886902 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 346/683] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:21 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:21.941823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c349affd-cf55-4beb-95c1-00b5976df7d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:21.942769 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c349affd-cf55-4beb-95c1-00b5976df7d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:21.962540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c349affd-cf55-4beb-95c1-00b5976df7d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.964163 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c349affd-cf55-4beb-95c1-00b5976df7d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.964979 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c349affd-cf55-4beb-95c1-00b5976df7d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.965418 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c349affd-cf55-4beb-95c1-00b5976df7d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.218575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0d3a040d-09d7-47ae-b161-0b1bedb6d09c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:22.219180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0d3a040d-09d7-47ae-b161-0b1bedb6d09c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:22.235822 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d3a040d-09d7-47ae-b161-0b1bedb6d09c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.236276 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d3a040d-09d7-47ae-b161-0b1bedb6d09c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.237065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d3a040d-09d7-47ae-b161-0b1bedb6d09c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.237499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d3a040d-09d7-47ae-b161-0b1bedb6d09c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.266833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c349affd-cf55-4beb-95c1-00b5976df7d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:22.273192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:22.283046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c349affd-cf55-4beb-95c1-00b5976df7d1 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.354250 Aug 02 09:11:22.287697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 338/684] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:21 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:22.457335 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0d3a040d-09d7-47ae-b161-0b1bedb6d09c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:22.466476 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0d3a040d-09d7-47ae-b161-0b1bedb6d09c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.251800 Aug 02 09:11:22.467058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 347/685] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:22 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:22.603421 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-0ac30194-65f2-4418-86c8-a7727cbd50cb req-ffa2990d-8376-49ac-b269-f93708abda0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd2ae24-eeb6-4170-9d44-990065e9d7bb", "tag": "85370a24-000e-466a-9b33-74fda60c702d"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:22.617095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-0ac30194-65f2-4418-86c8-a7727cbd50cb req-ffa2990d-8376-49ac-b269-f93708abda0e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.617792 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-0ac30194-65f2-4418-86c8-a7727cbd50cb req-ffa2990d-8376-49ac-b269-f93708abda0e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.635144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-0ac30194-65f2-4418-86c8-a7727cbd50cb req-ffa2990d-8376-49ac-b269-f93708abda0e service nova] Creating event network-changed:85370a24-000e-466a-9b33-74fda60c702d for instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb on hv-cinder-84713 Aug 02 09:11:22.644687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-0ac30194-65f2-4418-86c8-a7727cbd50cb req-ffa2990d-8376-49ac-b269-f93708abda0e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045369 Aug 02 09:11:22.654427 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 339/686] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:22.912525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:22.913751 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:22.922514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.923973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.929788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.930494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.954515 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-165401ee-f7c4-43bb-bb13-2714cc6e334f req-5d9ee1e4-e3ff-433f-9bee-d3237fb6390e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc844d0-e603-4cbd-9196-ef78031daa43", "name": "network-vif-plugged", "status": "completed", "tag": "95b4f3b0-a468-42f5-ae4f-42c268d708d9"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:22.965944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:22.978913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-165401ee-f7c4-43bb-bb13-2714cc6e334f req-5d9ee1e4-e3ff-433f-9bee-d3237fb6390e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.979872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-165401ee-f7c4-43bb-bb13-2714cc6e334f req-5d9ee1e4-e3ff-433f-9bee-d3237fb6390e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.998239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-165401ee-f7c4-43bb-bb13-2714cc6e334f req-5d9ee1e4-e3ff-433f-9bee-d3237fb6390e service nova] Creating event network-vif-plugged:95b4f3b0-a468-42f5-ae4f-42c268d708d9 for instance dbc844d0-e603-4cbd-9196-ef78031daa43 on hv-cinder-84713 Aug 02 09:11:23.005046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-165401ee-f7c4-43bb-bb13-2714cc6e334f req-5d9ee1e4-e3ff-433f-9bee-d3237fb6390e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058480 Aug 02 09:11:23.005961 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 340/687] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:11:23.189001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.223462 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.229553 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.236513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-22ccd068-1728-43c1-942d-d5eb9206223d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.327711 Aug 02 09:11:23.237183 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 348/688] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:22 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:23.314174 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-96a92fee-2510-4f06-af0c-d5268311d57b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:23.314911 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-96a92fee-2510-4f06-af0c-d5268311d57b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:23.323859 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96a92fee-2510-4f06-af0c-d5268311d57b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.324317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96a92fee-2510-4f06-af0c-d5268311d57b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.330050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96a92fee-2510-4f06-af0c-d5268311d57b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.330050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96a92fee-2510-4f06-af0c-d5268311d57b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.489292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e00d2d99-8b67-4b7f-a011-e61453ebeaf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:23.489975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e00d2d99-8b67-4b7f-a011-e61453ebeaf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:23.490908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-96a92fee-2510-4f06-af0c-d5268311d57b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.537995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e00d2d99-8b67-4b7f-a011-e61453ebeaf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.537995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e00d2d99-8b67-4b7f-a011-e61453ebeaf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.537995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e00d2d99-8b67-4b7f-a011-e61453ebeaf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.537995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e00d2d99-8b67-4b7f-a011-e61453ebeaf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.538426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-96a92fee-2510-4f06-af0c-d5268311d57b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.192578 Aug 02 09:11:23.538426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 341/689] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:23 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:23.652909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e00d2d99-8b67-4b7f-a011-e61453ebeaf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.662758 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e00d2d99-8b67-4b7f-a011-e61453ebeaf2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.178479 Aug 02 09:11:23.689343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 349/690] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:23 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:24.264578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:24.266061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:24.273053 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.273746 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.274722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.275322 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.522318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-873be4e7-9632-4107-9ab6-0b110be1c559 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:24.522799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-873be4e7-9632-4107-9ab6-0b110be1c559 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:24.530781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:24.537234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-873be4e7-9632-4107-9ab6-0b110be1c559 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.537963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-873be4e7-9632-4107-9ab6-0b110be1c559 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.539257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-873be4e7-9632-4107-9ab6-0b110be1c559 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.539856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-873be4e7-9632-4107-9ab6-0b110be1c559 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.545527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:24.550614 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:24.553152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-544a6b17-4a22-43e6-8e01-3c131c3904d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.293760 Aug 02 09:11:24.559708 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 342/691] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:24 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:24.709183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3531b2fc-cd06-47db-91c0-1bc40563154a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:24.709788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3531b2fc-cd06-47db-91c0-1bc40563154a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:24.715127 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=66 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:24.716713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-873be4e7-9632-4107-9ab6-0b110be1c559 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:24.721540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3531b2fc-cd06-47db-91c0-1bc40563154a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.722074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3531b2fc-cd06-47db-91c0-1bc40563154a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.723385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3531b2fc-cd06-47db-91c0-1bc40563154a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.723904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3531b2fc-cd06-47db-91c0-1bc40563154a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.741673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-873be4e7-9632-4107-9ab6-0b110be1c559 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.209559 Aug 02 09:11:24.741673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 350/692] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:24 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:24.903195 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3531b2fc-cd06-47db-91c0-1bc40563154a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:24.913134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3531b2fc-cd06-47db-91c0-1bc40563154a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.208241 Aug 02 09:11:24.913876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 343/693] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:24 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:25.582142 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:25.583103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:25.595804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.596475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.597969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.598590 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.750160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-175bc249-d42e-4afa-b793-ccb63d92881c tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:25.751003 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-175bc249-d42e-4afa-b793-ccb63d92881c tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:25.751407 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.765725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-175bc249-d42e-4afa-b793-ccb63d92881c tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.766508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-175bc249-d42e-4afa-b793-ccb63d92881c tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.767458 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-175bc249-d42e-4afa-b793-ccb63d92881c tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.768131 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-175bc249-d42e-4afa-b793-ccb63d92881c tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.770176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.772518 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.776213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-25c2a27a-739d-4b18-ba3d-28717eb331cf tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.198066 Aug 02 09:11:25.802073 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 351/694] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:25 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:25.935566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2e4bc195-c0b7-46c2-9378-81d85431ef63 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:25.936595 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2e4bc195-c0b7-46c2-9378-81d85431ef63 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:25.944896 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2e4bc195-c0b7-46c2-9378-81d85431ef63 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.946081 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2e4bc195-c0b7-46c2-9378-81d85431ef63 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.955442 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2e4bc195-c0b7-46c2-9378-81d85431ef63 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.957115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2e4bc195-c0b7-46c2-9378-81d85431ef63 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.981352 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-175bc249-d42e-4afa-b793-ccb63d92881c tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.991188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-175bc249-d42e-4afa-b793-ccb63d92881c tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.245202 Aug 02 09:11:26.017512 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 344/695] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:25 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:26.122661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2e4bc195-c0b7-46c2-9378-81d85431ef63 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:26.131795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2e4bc195-c0b7-46c2-9378-81d85431ef63 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.200294 Aug 02 09:11:26.132854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 352/696] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:25 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:26.807560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:26.808312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:26.815336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:26.816711 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:26.816911 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:26.817503 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:26.955630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:26.963758 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:26.965265 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:26.966458 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e14e5a86-ed82-490f-b12a-a46d35e5cff7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.164784 Aug 02 09:11:26.967032 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 345/697] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:26 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:27.013179 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-08f7ee94-616e-41b4-b7be-1ff975c2be84 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:27.013794 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-08f7ee94-616e-41b4-b7be-1ff975c2be84 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:27.021032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-08f7ee94-616e-41b4-b7be-1ff975c2be84 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.021594 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-08f7ee94-616e-41b4-b7be-1ff975c2be84 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.022394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-08f7ee94-616e-41b4-b7be-1ff975c2be84 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.022824 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-08f7ee94-616e-41b4-b7be-1ff975c2be84 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.158337 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7f1bd28a-4266-41b8-a704-7a8ca2217db4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:27.158948 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7f1bd28a-4266-41b8-a704-7a8ca2217db4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:27.165420 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7f1bd28a-4266-41b8-a704-7a8ca2217db4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.166106 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7f1bd28a-4266-41b8-a704-7a8ca2217db4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.167030 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7f1bd28a-4266-41b8-a704-7a8ca2217db4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.167623 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7f1bd28a-4266-41b8-a704-7a8ca2217db4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.168589 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:27.188629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=6 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:27.199605 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-08f7ee94-616e-41b4-b7be-1ff975c2be84 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:27.207467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-08f7ee94-616e-41b4-b7be-1ff975c2be84 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.198243 Aug 02 09:11:27.208256 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 353/698] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:27 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:27.435197 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:27.474704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7f1bd28a-4266-41b8-a704-7a8ca2217db4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:27.484626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7f1bd28a-4266-41b8-a704-7a8ca2217db4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.329810 Aug 02 09:11:27.485225 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 346/699] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:27 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:28.225840 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:28.227096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:28.228952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-66d41b60-be2f-4af6-8935-4af9ea36a776 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:28.229713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-66d41b60-be2f-4af6-8935-4af9ea36a776 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:28.241554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-66d41b60-be2f-4af6-8935-4af9ea36a776 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.242333 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-66d41b60-be2f-4af6-8935-4af9ea36a776 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.243478 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-66d41b60-be2f-4af6-8935-4af9ea36a776 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.244114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-66d41b60-be2f-4af6-8935-4af9ea36a776 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.245929 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.246587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.247362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.247964 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.437262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.448261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.453699 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.456919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dde4ab1c-18ce-4b75-9eac-e116cff313de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.468393 Aug 02 09:11:28.458328 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 354/700] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:27 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:28.524511 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3c24e7c8-cda1-4d67-aae5-d9bbdb37c067 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:28.525294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3c24e7c8-cda1-4d67-aae5-d9bbdb37c067 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:28.532123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3c24e7c8-cda1-4d67-aae5-d9bbdb37c067 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.532836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3c24e7c8-cda1-4d67-aae5-d9bbdb37c067 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.533839 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3c24e7c8-cda1-4d67-aae5-d9bbdb37c067 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.534526 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3c24e7c8-cda1-4d67-aae5-d9bbdb37c067 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.540883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-66d41b60-be2f-4af6-8935-4af9ea36a776 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.550225 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-66d41b60-be2f-4af6-8935-4af9ea36a776 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.325415 Aug 02 09:11:28.550849 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 347/701] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:28 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:28.712538 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3c24e7c8-cda1-4d67-aae5-d9bbdb37c067 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.722203 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3c24e7c8-cda1-4d67-aae5-d9bbdb37c067 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1367 microversion: 2.1 time: 0.201678 Aug 02 09:11:28.725661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 355/702] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:28 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:29.482233 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:29.482992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:29.491448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.491886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.492734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.493143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.577606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6203cd12-29a7-4437-9d28-57eb22d403cf tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:29.580113 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6203cd12-29a7-4437-9d28-57eb22d403cf tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:29.586912 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6203cd12-29a7-4437-9d28-57eb22d403cf tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.587582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6203cd12-29a7-4437-9d28-57eb22d403cf tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.588567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6203cd12-29a7-4437-9d28-57eb22d403cf tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.589223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6203cd12-29a7-4437-9d28-57eb22d403cf tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.703769 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.716642 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.716642 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.716642 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c5fe2526-ac68-465d-89a5-56e5940957e8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.238906 Aug 02 09:11:29.731284 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 348/703] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:29 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:29.758673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3f8e4c3c-f0dd-43d3-b0c6-420fb76b7cf6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:29.759696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3f8e4c3c-f0dd-43d3-b0c6-420fb76b7cf6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:29.775811 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3f8e4c3c-f0dd-43d3-b0c6-420fb76b7cf6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.776451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3f8e4c3c-f0dd-43d3-b0c6-420fb76b7cf6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.777624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3f8e4c3c-f0dd-43d3-b0c6-420fb76b7cf6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.778313 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3f8e4c3c-f0dd-43d3-b0c6-420fb76b7cf6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.782640 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6203cd12-29a7-4437-9d28-57eb22d403cf tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.792555 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6203cd12-29a7-4437-9d28-57eb22d403cf tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.219899 Aug 02 09:11:29.793436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 356/704] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:29 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:29.973644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3f8e4c3c-f0dd-43d3-b0c6-420fb76b7cf6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.984991 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3f8e4c3c-f0dd-43d3-b0c6-420fb76b7cf6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1556 microversion: 2.1 time: 0.241793 Aug 02 09:11:29.986526 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 349/705] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:29 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:30.035879 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9685471a-1147-4a86-bef0-4b1e011b09b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:30.036771 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9685471a-1147-4a86-bef0-4b1e011b09b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:30.046725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9685471a-1147-4a86-bef0-4b1e011b09b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.051131 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9685471a-1147-4a86-bef0-4b1e011b09b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.053840 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9685471a-1147-4a86-bef0-4b1e011b09b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.054736 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9685471a-1147-4a86-bef0-4b1e011b09b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.179370 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9685471a-1147-4a86-bef0-4b1e011b09b2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151843 Aug 02 09:11:30.180077 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 357/706] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 2 09:11:30 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:30.741480 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:30.742881 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:30.756389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.757403 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.758548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.759214 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.828874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-52d1b9a5-1fbd-4123-aa97-0d5e8f25f374 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:30.835101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-52d1b9a5-1fbd-4123-aa97-0d5e8f25f374 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:30.845751 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-52d1b9a5-1fbd-4123-aa97-0d5e8f25f374 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.847634 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-52d1b9a5-1fbd-4123-aa97-0d5e8f25f374 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.848708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-52d1b9a5-1fbd-4123-aa97-0d5e8f25f374 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.849330 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-52d1b9a5-1fbd-4123-aa97-0d5e8f25f374 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.980048 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:30.989776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:30.991326 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:30.992482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f3e7192f-fe7e-44e1-a82f-bdde73d1ee18 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.255001 Aug 02 09:11:30.993260 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 350/707] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:30 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:31.204062 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-52d1b9a5-1fbd-4123-aa97-0d5e8f25f374 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.213024 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-52d1b9a5-1fbd-4123-aa97-0d5e8f25f374 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.399449 Aug 02 09:11:31.213601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 358/708] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:30 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:31.867926 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:11:31.868812 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:11:32.025670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:32.025670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:32.032145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-e6a942f1-344a-4bea-9476-7465176d7024 req-b2c9d2a6-6098-47df-91db-9d5b32e493cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc844d0-e603-4cbd-9196-ef78031daa43", "tag": "95b4f3b0-a468-42f5-ae4f-42c268d708d9"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:32.046838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.050283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.050283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.053148 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.057949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-e6a942f1-344a-4bea-9476-7465176d7024 req-b2c9d2a6-6098-47df-91db-9d5b32e493cc service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.058686 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-e6a942f1-344a-4bea-9476-7465176d7024 req-b2c9d2a6-6098-47df-91db-9d5b32e493cc service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.089758 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-e6a942f1-344a-4bea-9476-7465176d7024 req-b2c9d2a6-6098-47df-91db-9d5b32e493cc service nova] Creating event network-changed:95b4f3b0-a468-42f5-ae4f-42c268d708d9 for instance dbc844d0-e603-4cbd-9196-ef78031daa43 on hv-cinder-84713 Aug 02 09:11:32.103129 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-e6a942f1-344a-4bea-9476-7465176d7024 req-b2c9d2a6-6098-47df-91db-9d5b32e493cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077629 Aug 02 09:11:32.110971 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 359/709] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:11:32.236176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e61c3144-a902-4c08-a976-4a5d29bac059 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:32.238219 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e61c3144-a902-4c08-a976-4a5d29bac059 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:32.256065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e61c3144-a902-4c08-a976-4a5d29bac059 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.256524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e61c3144-a902-4c08-a976-4a5d29bac059 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.257340 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e61c3144-a902-4c08-a976-4a5d29bac059 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.257784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e61c3144-a902-4c08-a976-4a5d29bac059 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.388581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:32.405944 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:32.408068 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:32.413212 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-11309f4e-0746-4723-b8e6-1100373df220 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.394921 Aug 02 09:11:32.415118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 351/710] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:32 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:32.531222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e61c3144-a902-4c08-a976-4a5d29bac059 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:32.531222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e61c3144-a902-4c08-a976-4a5d29bac059 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.294754 Aug 02 09:11:32.531222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 360/711] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:32 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:33.105522 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-b2f7c9bd-3bba-4369-bbdf-ad3ec8c44ef1 req-b5d3ca0b-d540-49cb-a57c-dcecb5eb7651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd2ae24-eeb6-4170-9d44-990065e9d7bb", "name": "network-vif-plugged", "status": "completed", "tag": "85370a24-000e-466a-9b33-74fda60c702d"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:33.117435 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-b2f7c9bd-3bba-4369-bbdf-ad3ec8c44ef1 req-b5d3ca0b-d540-49cb-a57c-dcecb5eb7651 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:33.117878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-b2f7c9bd-3bba-4369-bbdf-ad3ec8c44ef1 req-b5d3ca0b-d540-49cb-a57c-dcecb5eb7651 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:33.129636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-b2f7c9bd-3bba-4369-bbdf-ad3ec8c44ef1 req-b5d3ca0b-d540-49cb-a57c-dcecb5eb7651 service nova] Creating event network-vif-plugged:85370a24-000e-466a-9b33-74fda60c702d for instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb on hv-cinder-84713 Aug 02 09:11:33.134574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-b2f7c9bd-3bba-4369-bbdf-ad3ec8c44ef1 req-b5d3ca0b-d540-49cb-a57c-dcecb5eb7651 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033264 Aug 02 09:11:33.135153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 352/712] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:33.440120 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:33.440719 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:33.447547 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:33.448055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:33.448795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:33.449226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:33.554489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-67a9824f-ab6a-4ae1-97fb-a021297dca83 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:33.555265 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-67a9824f-ab6a-4ae1-97fb-a021297dca83 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:33.567362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-67a9824f-ab6a-4ae1-97fb-a021297dca83 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:33.567362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-67a9824f-ab6a-4ae1-97fb-a021297dca83 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:33.567362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-67a9824f-ab6a-4ae1-97fb-a021297dca83 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:33.567362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-67a9824f-ab6a-4ae1-97fb-a021297dca83 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:33.610075 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:33.618114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:33.619712 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:33.620973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f0ed6437-1c18-486e-9515-7efb7f131138 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.184805 Aug 02 09:11:33.621606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 361/713] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:33 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:33.723542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-67a9824f-ab6a-4ae1-97fb-a021297dca83 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:33.731135 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-67a9824f-ab6a-4ae1-97fb-a021297dca83 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.182871 Aug 02 09:11:33.731628 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 353/714] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:33 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:34.644430 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:34.645029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:34.651495 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.651942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.652738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.653170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.751776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7773aa8d-4eb8-41ca-a777-2bd8cb802b5d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:34.752484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7773aa8d-4eb8-41ca-a777-2bd8cb802b5d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:34.759223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7773aa8d-4eb8-41ca-a777-2bd8cb802b5d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.759745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7773aa8d-4eb8-41ca-a777-2bd8cb802b5d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.760710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7773aa8d-4eb8-41ca-a777-2bd8cb802b5d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.761245 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7773aa8d-4eb8-41ca-a777-2bd8cb802b5d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.788462 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.796804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.798387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.800182 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1aa0d402-af8b-4f71-96b6-46fefcc84bb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1737 microversion: 2.20 time: 0.158972 Aug 02 09:11:34.800868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 362/715] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:34 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:34.900028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7773aa8d-4eb8-41ca-a777-2bd8cb802b5d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.907362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7773aa8d-4eb8-41ca-a777-2bd8cb802b5d tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.159601 Aug 02 09:11:34.907923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 354/716] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:34 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:35.823757 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:35.824363 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:35.831373 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.831821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.832589 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.833015 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.928429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cb8e4e49-5506-4720-a0ed-5182fe57faa4 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:35.929025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cb8e4e49-5506-4720-a0ed-5182fe57faa4 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:35.936202 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb8e4e49-5506-4720-a0ed-5182fe57faa4 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.936649 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb8e4e49-5506-4720-a0ed-5182fe57faa4 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.937422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb8e4e49-5506-4720-a0ed-5182fe57faa4 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.937848 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb8e4e49-5506-4720-a0ed-5182fe57faa4 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.967736 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.976606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.978849 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.980531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ef6574c8-80e0-45cc-81f7-688930b880e3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1719 microversion: 2.20 time: 0.160820 Aug 02 09:11:35.981523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 363/717] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:35 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:36.072091 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cb8e4e49-5506-4720-a0ed-5182fe57faa4 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:36.080016 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cb8e4e49-5506-4720-a0ed-5182fe57faa4 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1319 microversion: 2.1 time: 0.155299 Aug 02 09:11:36.081253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 355/718] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:35 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:37.004501 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:37.005097 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:37.011571 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:37.012012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.012770 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:37.013333 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.100950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-84afa2e9-1063-43fd-b616-bf6107d92562 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:37.101590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-84afa2e9-1063-43fd-b616-bf6107d92562 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:37.108255 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-84afa2e9-1063-43fd-b616-bf6107d92562 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:37.108702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-84afa2e9-1063-43fd-b616-bf6107d92562 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.109475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-84afa2e9-1063-43fd-b616-bf6107d92562 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:37.109985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-84afa2e9-1063-43fd-b616-bf6107d92562 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.146297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.154733 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.156251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.157414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9396c862-83c8-46fe-87ea-ae6d129fdd6c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1719 microversion: 2.20 time: 0.156897 Aug 02 09:11:37.158333 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 364/719] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:36 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:37.243415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-84afa2e9-1063-43fd-b616-bf6107d92562 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.251032 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-84afa2e9-1063-43fd-b616-bf6107d92562 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1508 microversion: 2.1 time: 0.153902 Aug 02 09:11:37.251599 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 356/720] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:37 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:37.273516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0ea6610f-179b-461f-ad7f-1c83895525e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4d9ecd9-7b60-4f6f-8905-3f79c5ac8ba9", "device": "/dev/sdb"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:37.276011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0ea6610f-179b-461f-ad7f-1c83895525e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:37.282045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0ea6610f-179b-461f-ad7f-1c83895525e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:37.282493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0ea6610f-179b-461f-ad7f-1c83895525e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.283265 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0ea6610f-179b-461f-ad7f-1c83895525e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:37.283734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0ea6610f-179b-461f-ad7f-1c83895525e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.181223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:38.181855 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:38.188401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.188856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.189621 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.190121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.208608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:38.323121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:38.332047 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:38.333549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:38.334760 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0741ed7c-380e-477b-962f-29fd7a96c992 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1719 microversion: 2.20 time: 0.157415 Aug 02 09:11:38.335318 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 357/721] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:38 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:38.664811 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:38.884881 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-091a3d68-3421-4b7f-9be3-053c3288e8a2 req-5e6dd22c-164e-4052-905c-e7e50d40ce8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c248147-71ed-4f5f-89cc-8ca12974efb4", "name": "network-vif-unplugged", "status": "completed", "tag": "27491509-00ef-451e-b2ac-f08e653e8310"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:38.894382 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-091a3d68-3421-4b7f-9be3-053c3288e8a2 req-5e6dd22c-164e-4052-905c-e7e50d40ce8c service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.894967 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-091a3d68-3421-4b7f-9be3-053c3288e8a2 req-5e6dd22c-164e-4052-905c-e7e50d40ce8c service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.905600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-091a3d68-3421-4b7f-9be3-053c3288e8a2 req-5e6dd22c-164e-4052-905c-e7e50d40ce8c service nova] Creating event network-vif-unplugged:27491509-00ef-451e-b2ac-f08e653e8310 for instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 on hv-cinder-84713 Aug 02 09:11:38.910477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-091a3d68-3421-4b7f-9be3-053c3288e8a2 req-5e6dd22c-164e-4052-905c-e7e50d40ce8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029184 Aug 02 09:11:38.911042 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 358/722] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:11:39.241111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0ea6610f-179b-461f-ad7f-1c83895525e0 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "POST /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.971118 Aug 02 09:11:39.241662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 365/723] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:11:37 2022] POST /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb/os-volume_attachments => generated 194 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:39.358254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:39.358942 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:39.365799 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.366281 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.367048 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.367483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.507474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.515896 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.519867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.519867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c83acb55-4a6f-44d3-8489-e3d1e8a1a713 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1722 microversion: 2.20 time: 0.165578 Aug 02 09:11:39.519867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 359/724] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:39 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:39.545286 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fedb0367-4fc9-454e-a3ef-2b5c7469ad2d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63359b8e-3274-4565-8cbe-4fd7460f2f0e"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:39.548602 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fedb0367-4fc9-454e-a3ef-2b5c7469ad2d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:39.574910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fedb0367-4fc9-454e-a3ef-2b5c7469ad2d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.574910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fedb0367-4fc9-454e-a3ef-2b5c7469ad2d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.574910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fedb0367-4fc9-454e-a3ef-2b5c7469ad2d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.574910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fedb0367-4fc9-454e-a3ef-2b5c7469ad2d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.507141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fedb0367-4fc9-454e-a3ef-2b5c7469ad2d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.968340 Aug 02 09:11:40.507781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 366/725] 10.222.0.46 () {62 vars in 1364 bytes} [Tue Aug 2 09:11:39 2022] POST /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments => generated 188 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:11:40.640666 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5e9ae591-c9f2-4c2f-85df-81255c4328af tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:40.641286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5e9ae591-c9f2-4c2f-85df-81255c4328af tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:40.647875 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e9ae591-c9f2-4c2f-85df-81255c4328af tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.649950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e9ae591-c9f2-4c2f-85df-81255c4328af tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.649950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e9ae591-c9f2-4c2f-85df-81255c4328af tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.649950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e9ae591-c9f2-4c2f-85df-81255c4328af tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.794369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5e9ae591-c9f2-4c2f-85df-81255c4328af tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118368) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:11:41.059812 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5e9ae591-c9f2-4c2f-85df-81255c4328af tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/action" status: 202 len: 0 microversion: 2.20 time: 0.422789 Aug 02 09:11:41.060641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 360/726] 10.222.0.46 () {62 vars in 1319 bytes} [Tue Aug 2 09:11:40 2022] POST /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:11:41.069664 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:41.072476 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:41.079307 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:41.079820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.081147 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:41.081576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.218451 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.227860 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.229535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.230738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-549d5d79-1d82-4ba4-8944-0c33e80b156d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1748 microversion: 2.20 time: 0.165924 Aug 02 09:11:41.231305 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 367/727] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:41 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:42.254542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:42.255150 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:42.261734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.262222 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.264519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.264519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.400799 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:42.409572 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:42.411106 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:42.412256 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-62aa53a9-8a6f-44fb-885e-5c6e741748a7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1748 microversion: 2.20 time: 0.162272 Aug 02 09:11:42.412817 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 361/728] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:42 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:43.436588 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:43.437196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:43.443828 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.444279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.445297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.445733 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.583214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.592518 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.594072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.595223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-05b7d547-d141-493a-9020-e4f0be733a93 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.162551 Aug 02 09:11:43.596826 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 368/729] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:43 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:44.619519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:44.620114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:44.627217 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.627705 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.628558 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.628994 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.760770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:44.770307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:44.771801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:44.772964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-12afce20-91da-4c65-9a28-122f639a7d8a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.157458 Aug 02 09:11:44.773514 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 362/730] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:44 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:45.796854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:45.797459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:45.804415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.804863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.805650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.806129 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.942278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.951703 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.953246 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.954484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-56e9aa7d-c807-47f6-ab43-dca371d18e2a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.161629 Aug 02 09:11:45.955039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 369/731] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:45 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:46.979795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:46.980465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:46.987502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.987952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.988743 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.989183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.048902 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d5e47ddf-9b87-4937-9fc4-314635810648 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:47.050880 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d5e47ddf-9b87-4937-9fc4-314635810648 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:47.058240 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5e47ddf-9b87-4937-9fc4-314635810648 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.058692 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5e47ddf-9b87-4937-9fc4-314635810648 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.059724 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5e47ddf-9b87-4937-9fc4-314635810648 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.060172 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d5e47ddf-9b87-4937-9fc4-314635810648 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.138090 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.147649 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.150356 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.150356 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9f86be2f-8af6-4924-a774-8da914dfef3c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.174892 Aug 02 09:11:47.150880 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 363/732] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:46 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:47.666658 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d5e47ddf-9b87-4937-9fc4-314635810648 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "POST /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/action" status: 202 len: 0 microversion: 2.1 time: 0.622277 Aug 02 09:11:47.667299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 370/733] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:11:47 2022] POST /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:11:47.675501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2bb5f5ee-fc02-4c71-9e1a-2256142c20f6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:47.676108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2bb5f5ee-fc02-4c71-9e1a-2256142c20f6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:47.682795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2bb5f5ee-fc02-4c71-9e1a-2256142c20f6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.683244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2bb5f5ee-fc02-4c71-9e1a-2256142c20f6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.684001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2bb5f5ee-fc02-4c71-9e1a-2256142c20f6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.684431 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2bb5f5ee-fc02-4c71-9e1a-2256142c20f6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.835854 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2bb5f5ee-fc02-4c71-9e1a-2256142c20f6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.843974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2bb5f5ee-fc02-4c71-9e1a-2256142c20f6 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1754 microversion: 2.1 time: 0.172467 Aug 02 09:11:47.844612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 364/734] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:47 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:48.175894 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:48.176618 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:48.183522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.183979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.184768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.185204 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.334353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:48.343583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:48.345129 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:48.347921 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-52617ac6-e41f-4d80-9d2e-ce9d910dbca9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.175511 Aug 02 09:11:48.347921 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 371/735] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:48 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:48.868057 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-87dce2c0-0647-4ced-9aed-a11a6b899b68 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:48.868685 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-87dce2c0-0647-4ced-9aed-a11a6b899b68 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:48.875507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-87dce2c0-0647-4ced-9aed-a11a6b899b68 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.875945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-87dce2c0-0647-4ced-9aed-a11a6b899b68 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.876723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-87dce2c0-0647-4ced-9aed-a11a6b899b68 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.877148 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-87dce2c0-0647-4ced-9aed-a11a6b899b68 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.047898 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-87dce2c0-0647-4ced-9aed-a11a6b899b68 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.057203 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-87dce2c0-0647-4ced-9aed-a11a6b899b68 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1754 microversion: 2.1 time: 0.192850 Aug 02 09:11:49.062628 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 365/736] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:48 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:49.371256 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:49.372202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:49.379080 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.379557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.380329 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.380803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.515070 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.524080 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.525665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.526767 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f629bf8b-0773-410b-b29f-85dafcf8d207 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.160736 Aug 02 09:11:49.527314 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 372/737] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:49 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:50.084133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fc60be31-392a-4cf6-a9b5-14e421f42339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:50.084754 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fc60be31-392a-4cf6-a9b5-14e421f42339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:50.091732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fc60be31-392a-4cf6-a9b5-14e421f42339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.092184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fc60be31-392a-4cf6-a9b5-14e421f42339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.092950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fc60be31-392a-4cf6-a9b5-14e421f42339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.093385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fc60be31-392a-4cf6-a9b5-14e421f42339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.239861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fc60be31-392a-4cf6-a9b5-14e421f42339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.247853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fc60be31-392a-4cf6-a9b5-14e421f42339 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.167662 Aug 02 09:11:50.248417 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 366/738] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:50 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:50.550181 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:50.550781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:50.557292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.557761 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.558544 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.558971 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.688531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.697214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.698755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.699910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b2726b32-d76e-4d3d-a6ce-c39c3fad7852 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.154092 Aug 02 09:11:50.700462 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 373/739] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:50 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:51.270342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b2dcf09f-2b22-434a-92ff-79de25f1b1a4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:51.270862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b2dcf09f-2b22-434a-92ff-79de25f1b1a4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:51.277284 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b2dcf09f-2b22-434a-92ff-79de25f1b1a4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.277720 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b2dcf09f-2b22-434a-92ff-79de25f1b1a4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.278513 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b2dcf09f-2b22-434a-92ff-79de25f1b1a4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.278941 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b2dcf09f-2b22-434a-92ff-79de25f1b1a4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.425026 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b2dcf09f-2b22-434a-92ff-79de25f1b1a4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.433434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b2dcf09f-2b22-434a-92ff-79de25f1b1a4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.167577 Aug 02 09:11:51.434158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 367/740] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:51 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:51.723182 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:51.723824 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:51.726307 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=58 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:51.731227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.731682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.732447 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.732883 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.864243 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.873018 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.874566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.875724 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5937ecc6-2733-43a5-9409-389138556552 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.157113 Aug 02 09:11:51.876284 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 374/741] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:51 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:52.456569 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-be9d0f51-eac6-4dfc-9ef0-5136531a8b2b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.457188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-be9d0f51-eac6-4dfc-9ef0-5136531a8b2b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.463845 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be9d0f51-eac6-4dfc-9ef0-5136531a8b2b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.464289 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be9d0f51-eac6-4dfc-9ef0-5136531a8b2b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.465054 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be9d0f51-eac6-4dfc-9ef0-5136531a8b2b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.465486 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be9d0f51-eac6-4dfc-9ef0-5136531a8b2b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.610441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-be9d0f51-eac6-4dfc-9ef0-5136531a8b2b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:52.618725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-be9d0f51-eac6-4dfc-9ef0-5136531a8b2b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.166486 Aug 02 09:11:52.619433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 368/742] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:52 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:52.898135 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.898765 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.905358 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.905807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.906609 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.907048 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.034937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:53.043143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:53.044623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:53.045748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6cfa71c0-2974-4637-a5f9-ad3d7c939605 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.151557 Aug 02 09:11:53.046331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 375/743] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:52 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:53.640925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-11d53ec7-cf5a-46fd-b0f4-ce8246cc0d09 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:53.641532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-11d53ec7-cf5a-46fd-b0f4-ce8246cc0d09 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:53.648481 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11d53ec7-cf5a-46fd-b0f4-ce8246cc0d09 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.648930 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11d53ec7-cf5a-46fd-b0f4-ce8246cc0d09 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.649805 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11d53ec7-cf5a-46fd-b0f4-ce8246cc0d09 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.650278 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11d53ec7-cf5a-46fd-b0f4-ce8246cc0d09 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.791589 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-11d53ec7-cf5a-46fd-b0f4-ce8246cc0d09 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:53.799806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-11d53ec7-cf5a-46fd-b0f4-ce8246cc0d09 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.162707 Aug 02 09:11:53.800371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 369/744] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:53 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:54.076062 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:54.076062 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:54.078644 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:54.079094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:54.080483 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:54.080947 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:54.214938 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.223419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.224904 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.226077 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-57306ec5-9fa7-47b9-be65-61cd60e7d954 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1750 microversion: 2.20 time: 0.158778 Aug 02 09:11:54.226637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 376/745] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:54 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:54.821105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-04eb6db8-7344-4731-b78c-e7a1484960f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:54.821702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-04eb6db8-7344-4731-b78c-e7a1484960f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:54.824257 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:54.829209 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-04eb6db8-7344-4731-b78c-e7a1484960f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:54.829680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-04eb6db8-7344-4731-b78c-e7a1484960f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:54.830462 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-04eb6db8-7344-4731-b78c-e7a1484960f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:54.830890 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-04eb6db8-7344-4731-b78c-e7a1484960f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:54.984472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-04eb6db8-7344-4731-b78c-e7a1484960f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.993648 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-04eb6db8-7344-4731-b78c-e7a1484960f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.176615 Aug 02 09:11:54.994242 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 370/746] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:54 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:55.248597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:55.249202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:55.255731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.256180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.256958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.257390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.399598 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.402981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:55.409058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.410612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.415769 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4e09f244-37ce-42bf-be73-ad1832fdde88 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.167099 Aug 02 09:11:55.415769 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 377/747] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:55 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:56.015085 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-88858a21-5e9a-48ab-8df6-f0df195a65e1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:56.015763 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-88858a21-5e9a-48ab-8df6-f0df195a65e1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:56.023018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88858a21-5e9a-48ab-8df6-f0df195a65e1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.023466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88858a21-5e9a-48ab-8df6-f0df195a65e1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.024231 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88858a21-5e9a-48ab-8df6-f0df195a65e1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.024768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88858a21-5e9a-48ab-8df6-f0df195a65e1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.171595 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-88858a21-5e9a-48ab-8df6-f0df195a65e1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:56.180300 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-88858a21-5e9a-48ab-8df6-f0df195a65e1 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.169063 Aug 02 09:11:56.180880 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 371/748] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:56 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:56.436225 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:56.436936 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:56.444754 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.445205 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.446005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.446442 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.598216 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:56.608346 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:56.610824 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:56.612104 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-395b52db-cffe-4297-8fd6-ef88e114109c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.179871 Aug 02 09:11:56.622273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 378/749] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:56 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:57.210710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9ce995f5-f8ff-45c9-9442-1a70992c1dfa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:57.212773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9ce995f5-f8ff-45c9-9442-1a70992c1dfa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:57.224448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9ce995f5-f8ff-45c9-9442-1a70992c1dfa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.225276 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9ce995f5-f8ff-45c9-9442-1a70992c1dfa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.226376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9ce995f5-f8ff-45c9-9442-1a70992c1dfa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.226920 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9ce995f5-f8ff-45c9-9442-1a70992c1dfa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.404033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9ce995f5-f8ff-45c9-9442-1a70992c1dfa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.412498 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9ce995f5-f8ff-45c9-9442-1a70992c1dfa tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.211936 Aug 02 09:11:57.413072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 372/750] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:57 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:57.635343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:57.635947 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:57.642344 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.642789 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.643648 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.643992 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.793151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.803150 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.804668 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.806006 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-183d0620-5fe0-443a-b03f-0d0566d8d4b3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.175198 Aug 02 09:11:57.806475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 379/751] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:57 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:58.435063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-92301661-75e4-4333-9155-769d6d3a6d39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:58.435694 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-92301661-75e4-4333-9155-769d6d3a6d39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:58.443538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-92301661-75e4-4333-9155-769d6d3a6d39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.443987 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-92301661-75e4-4333-9155-769d6d3a6d39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.445011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-92301661-75e4-4333-9155-769d6d3a6d39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.445448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-92301661-75e4-4333-9155-769d6d3a6d39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.585868 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-92301661-75e4-4333-9155-769d6d3a6d39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.589598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:58.594505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-92301661-75e4-4333-9155-769d6d3a6d39 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.163276 Aug 02 09:11:58.595570 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 373/752] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:58 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:58.831251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:58.831845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:58.838426 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.838869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.839619 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.840045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.969173 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.978219 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.979719 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.980857 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a31c0246-afe0-4a34-a442-825f14cd5e0a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.154014 Aug 02 09:11:58.981419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 380/753] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:58 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:59.617222 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1a8bf5cc-a5d6-45df-8730-9b68d208f059 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:59.618072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1a8bf5cc-a5d6-45df-8730-9b68d208f059 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:59.626109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1a8bf5cc-a5d6-45df-8730-9b68d208f059 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.629118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1a8bf5cc-a5d6-45df-8730-9b68d208f059 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.629118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1a8bf5cc-a5d6-45df-8730-9b68d208f059 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.629118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1a8bf5cc-a5d6-45df-8730-9b68d208f059 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.823095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1a8bf5cc-a5d6-45df-8730-9b68d208f059 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:59.831041 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1a8bf5cc-a5d6-45df-8730-9b68d208f059 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.218076 Aug 02 09:11:59.831832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 374/754] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:59 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:00.004193 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:00.004862 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:00.011566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.012010 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.012766 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.013193 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.151444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:00.161665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:00.163219 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:00.164393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b06ec6ea-41ed-4569-bae2-30d04700088f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.164174 Aug 02 09:12:00.164984 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 381/755] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:59 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:00.852465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cceb6126-d7fd-4197-9c2f-734e856bc53a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:00.853150 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cceb6126-d7fd-4197-9c2f-734e856bc53a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:00.859872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cceb6126-d7fd-4197-9c2f-734e856bc53a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.860320 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cceb6126-d7fd-4197-9c2f-734e856bc53a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.861098 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cceb6126-d7fd-4197-9c2f-734e856bc53a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.861533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cceb6126-d7fd-4197-9c2f-734e856bc53a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.005910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cceb6126-d7fd-4197-9c2f-734e856bc53a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.013903 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cceb6126-d7fd-4197-9c2f-734e856bc53a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.165411 Aug 02 09:12:01.014489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 375/756] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:00 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:01.187967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:01.188577 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:01.195541 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.196004 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.196979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.197416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.339642 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.350271 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.358059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.358059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-885ad002-7637-4c40-92b2-7445383a2029 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.169015 Aug 02 09:12:01.358059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 382/757] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:01 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:02.037016 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7b65ef7e-5a7e-456f-b5b8-224ef7481e42 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:02.037614 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7b65ef7e-5a7e-456f-b5b8-224ef7481e42 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:02.044115 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7b65ef7e-5a7e-456f-b5b8-224ef7481e42 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.044558 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7b65ef7e-5a7e-456f-b5b8-224ef7481e42 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.045312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7b65ef7e-5a7e-456f-b5b8-224ef7481e42 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.045739 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7b65ef7e-5a7e-456f-b5b8-224ef7481e42 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.376832 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:02.377425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:02.384720 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.385186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.385980 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.386423 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.465107 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7b65ef7e-5a7e-456f-b5b8-224ef7481e42 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:02.474022 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7b65ef7e-5a7e-456f-b5b8-224ef7481e42 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.441667 Aug 02 09:12:02.474691 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 376/758] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:02 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:02.525640 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:02.530290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:02.531813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:02.533626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2be047a3-c285-41cb-9a12-58a1a0f21997 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.160773 Aug 02 09:12:02.534223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 383/759] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:02 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:03.496232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c06939d6-5978-4e07-b175-201a20bcae31 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:03.496931 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c06939d6-5978-4e07-b175-201a20bcae31 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:03.503441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c06939d6-5978-4e07-b175-201a20bcae31 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.503891 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c06939d6-5978-4e07-b175-201a20bcae31 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.504654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c06939d6-5978-4e07-b175-201a20bcae31 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.505096 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c06939d6-5978-4e07-b175-201a20bcae31 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.558283 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:03.558895 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:03.565345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.565798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.566615 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.567051 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.647463 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c06939d6-5978-4e07-b175-201a20bcae31 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:03.656145 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c06939d6-5978-4e07-b175-201a20bcae31 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.163799 Aug 02 09:12:03.656820 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 377/760] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:03 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:03.697802 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:03.707029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:03.708515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:03.709655 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-88ee69dc-7bc7-4501-be0d-f87338d5deca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.155334 Aug 02 09:12:03.710266 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 384/761] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:03 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:04.679960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-268af287-86f3-483e-a799-eb39595c1c6c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:04.680574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-268af287-86f3-483e-a799-eb39595c1c6c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:04.687076 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-268af287-86f3-483e-a799-eb39595c1c6c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.687530 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-268af287-86f3-483e-a799-eb39595c1c6c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.688299 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-268af287-86f3-483e-a799-eb39595c1c6c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.688738 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-268af287-86f3-483e-a799-eb39595c1c6c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.732785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:04.733411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:04.740497 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.740943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.741706 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.742166 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.836263 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-268af287-86f3-483e-a799-eb39595c1c6c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:04.845114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-268af287-86f3-483e-a799-eb39595c1c6c tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.168953 Aug 02 09:12:04.845697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 378/762] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:04 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:04.885116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:04.894567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:04.896084 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:04.897247 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e328c2ed-ac12-4f29-be9b-ae1b71275d5a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.168300 Aug 02 09:12:04.898185 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 385/763] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:04 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:05.866788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-87b39b36-cd3b-4b35-827b-42966338e7f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:05.867406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-87b39b36-cd3b-4b35-827b-42966338e7f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:05.874036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-87b39b36-cd3b-4b35-827b-42966338e7f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.874492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-87b39b36-cd3b-4b35-827b-42966338e7f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.875258 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-87b39b36-cd3b-4b35-827b-42966338e7f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.875696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-87b39b36-cd3b-4b35-827b-42966338e7f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.919685 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:05.920356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:05.927300 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.927757 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.928539 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.928978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:06.025208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-87b39b36-cd3b-4b35-827b-42966338e7f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:06.035205 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-87b39b36-cd3b-4b35-827b-42966338e7f9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.172407 Aug 02 09:12:06.035783 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 379/764] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:05 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:06.071065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:06.080515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:06.082443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:06.083195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-507a5711-52b7-43d5-9f3b-7c7e6cb1a66b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.167490 Aug 02 09:12:06.083958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 386/765] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:05 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:07.056449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ea79bffd-3b09-4dfc-8ddd-6d717b5cb011 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:07.056982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ea79bffd-3b09-4dfc-8ddd-6d717b5cb011 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:07.063492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea79bffd-3b09-4dfc-8ddd-6d717b5cb011 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.063938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea79bffd-3b09-4dfc-8ddd-6d717b5cb011 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.064703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea79bffd-3b09-4dfc-8ddd-6d717b5cb011 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.065139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ea79bffd-3b09-4dfc-8ddd-6d717b5cb011 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.106094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:07.106706 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:07.113340 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.113794 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.114606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.115053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.260045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ea79bffd-3b09-4dfc-8ddd-6d717b5cb011 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:07.263253 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:07.268890 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ea79bffd-3b09-4dfc-8ddd-6d717b5cb011 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.216285 Aug 02 09:12:07.269496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 380/766] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:07 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:07.272434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:07.274051 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:07.275207 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-26f57656-9e6d-4ff8-ae97-776aab9f2607 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.173494 Aug 02 09:12:07.275752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 387/767] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:07 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:08.291090 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7d5c51cc-a3df-488b-8c60-ed1d61534ae0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:08.291767 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7d5c51cc-a3df-488b-8c60-ed1d61534ae0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:08.298990 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7d5c51cc-a3df-488b-8c60-ed1d61534ae0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.299363 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:08.299838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7d5c51cc-a3df-488b-8c60-ed1d61534ae0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.299978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:08.300345 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7d5c51cc-a3df-488b-8c60-ed1d61534ae0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.300772 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7d5c51cc-a3df-488b-8c60-ed1d61534ae0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.306952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.307399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.308168 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.308783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.458251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:08.464066 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7d5c51cc-a3df-488b-8c60-ed1d61534ae0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:08.470113 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:08.471884 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:08.473521 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-088e693e-6ebb-4b75-8dc7-51770afdae82 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.177921 Aug 02 09:12:08.474329 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 388/768] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:08 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:08.479159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7d5c51cc-a3df-488b-8c60-ed1d61534ae0 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.191758 Aug 02 09:12:08.494608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 381/769] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:08 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:09.497581 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:09.498473 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:09.505736 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-167310ab-94ed-4e26-8287-4b69a3af8760 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:09.506406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-167310ab-94ed-4e26-8287-4b69a3af8760 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:09.508442 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.508892 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.510804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.511244 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.515204 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-167310ab-94ed-4e26-8287-4b69a3af8760 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.515661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-167310ab-94ed-4e26-8287-4b69a3af8760 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.516495 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-167310ab-94ed-4e26-8287-4b69a3af8760 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.516930 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-167310ab-94ed-4e26-8287-4b69a3af8760 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.705441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:09.727472 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:09.742529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:09.744302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3decb672-9096-4c99-adc2-7808312b8e76 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.250927 Aug 02 09:12:09.745016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 389/770] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:09 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:09.760423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-167310ab-94ed-4e26-8287-4b69a3af8760 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:09.769485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-167310ab-94ed-4e26-8287-4b69a3af8760 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.269308 Aug 02 09:12:09.770114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 382/771] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:09 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:10.777345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:10.777966 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:10.784480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.784930 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.785725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.786196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.800253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6652b313-14ef-4e8b-bfce-56de36695d36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:10.800897 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6652b313-14ef-4e8b-bfce-56de36695d36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:10.807910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6652b313-14ef-4e8b-bfce-56de36695d36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.808367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6652b313-14ef-4e8b-bfce-56de36695d36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.809206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6652b313-14ef-4e8b-bfce-56de36695d36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.809742 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6652b313-14ef-4e8b-bfce-56de36695d36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.925241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:10.934444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:10.936386 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:10.937573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6fe76f11-d864-4b4d-89ef-99d91c82d184 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.164118 Aug 02 09:12:10.938487 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 390/772] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:10 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:10.969400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6652b313-14ef-4e8b-bfce-56de36695d36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:10.978687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6652b313-14ef-4e8b-bfce-56de36695d36 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.182749 Aug 02 09:12:10.979264 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 383/773] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:10 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:11.961936 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:11.962549 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:11.969170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:11.969624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:11.970432 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:11.970870 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.000842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-46fad790-6cb5-4e00-b805-9eaa0485080b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:12.001667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-46fad790-6cb5-4e00-b805-9eaa0485080b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:12.009031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-46fad790-6cb5-4e00-b805-9eaa0485080b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.009524 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-46fad790-6cb5-4e00-b805-9eaa0485080b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.010324 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-46fad790-6cb5-4e00-b805-9eaa0485080b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.010756 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-46fad790-6cb5-4e00-b805-9eaa0485080b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.118719 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:12.127959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:12.129485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:12.130741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8652183f-9246-4849-8faf-b7c9e084afea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.173315 Aug 02 09:12:12.131314 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 391/774] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:11 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:12.163084 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-46fad790-6cb5-4e00-b805-9eaa0485080b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:12.171156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-46fad790-6cb5-4e00-b805-9eaa0485080b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.174297 Aug 02 09:12:12.171762 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 384/775] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:11 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:13.154994 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:13.155739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:13.162359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.162814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.163582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.164019 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.193073 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-47b3b774-f5c8-4cdc-ae4b-8939840e30a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:13.194024 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-47b3b774-f5c8-4cdc-ae4b-8939840e30a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:13.200523 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47b3b774-f5c8-4cdc-ae4b-8939840e30a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.200961 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47b3b774-f5c8-4cdc-ae4b-8939840e30a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.201724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47b3b774-f5c8-4cdc-ae4b-8939840e30a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.202177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47b3b774-f5c8-4cdc-ae4b-8939840e30a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.300922 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:13.311437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:13.312950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:13.314162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-bedee3ee-08e7-4b76-80a1-7efd0fee01ac tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.163216 Aug 02 09:12:13.315572 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 392/776] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:13 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:13.363143 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-47b3b774-f5c8-4cdc-ae4b-8939840e30a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:13.371711 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-47b3b774-f5c8-4cdc-ae4b-8939840e30a2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.182922 Aug 02 09:12:13.372310 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 385/777] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:13 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:14.339723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:14.340497 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:14.347625 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.349959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.349959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.349959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.397639 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5b787f70-ea1a-4497-9a9d-fd6ea4e99abd tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:14.398713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5b787f70-ea1a-4497-9a9d-fd6ea4e99abd tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:14.406592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b787f70-ea1a-4497-9a9d-fd6ea4e99abd tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.407321 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b787f70-ea1a-4497-9a9d-fd6ea4e99abd tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.408669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b787f70-ea1a-4497-9a9d-fd6ea4e99abd tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.409433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5b787f70-ea1a-4497-9a9d-fd6ea4e99abd tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.491681 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:14.508573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:14.510563 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:14.511607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a1654c6f-5f7c-4e40-b1d6-b78bf2fdead1 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.175887 Aug 02 09:12:14.512298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 393/778] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:14 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:14.585622 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5b787f70-ea1a-4497-9a9d-fd6ea4e99abd tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:14.593950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5b787f70-ea1a-4497-9a9d-fd6ea4e99abd tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.202242 Aug 02 09:12:14.594501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 386/779] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:14 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:15.536838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:15.537438 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:15.544269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:15.544711 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.545484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:15.545904 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.564813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:15.615324 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-08f191de-fa07-4cb8-b586-eb55d72ebc4a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:15.616003 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-08f191de-fa07-4cb8-b586-eb55d72ebc4a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:15.622792 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08f191de-fa07-4cb8-b586-eb55d72ebc4a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:15.623255 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08f191de-fa07-4cb8-b586-eb55d72ebc4a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.624033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08f191de-fa07-4cb8-b586-eb55d72ebc4a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:15.624469 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08f191de-fa07-4cb8-b586-eb55d72ebc4a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.683858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:15.692926 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:15.694721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:15.695883 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-27bf2c94-1918-4a3f-b40b-fa72fb375780 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.163542 Aug 02 09:12:15.696444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 394/780] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:15 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:15.793817 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-08f191de-fa07-4cb8-b586-eb55d72ebc4a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:15.802106 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-08f191de-fa07-4cb8-b586-eb55d72ebc4a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.190474 Aug 02 09:12:15.802689 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 387/781] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:15 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:16.723923 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:16.732343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:16.742376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.742837 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.743656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.744364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.825127 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4b0badda-3857-4af2-9ee8-0b7a58a57151 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:16.826667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4b0badda-3857-4af2-9ee8-0b7a58a57151 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:16.834229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b0badda-3857-4af2-9ee8-0b7a58a57151 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.844483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b0badda-3857-4af2-9ee8-0b7a58a57151 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.846238 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b0badda-3857-4af2-9ee8-0b7a58a57151 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.846833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b0badda-3857-4af2-9ee8-0b7a58a57151 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.916583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:16.937999 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:16.937999 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:16.941907 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c1d29e92-f2d7-4c0d-8610-6a49a8827b0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.220912 Aug 02 09:12:16.942465 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 395/782] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:16 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:17.040822 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4b0badda-3857-4af2-9ee8-0b7a58a57151 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:17.049046 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4b0badda-3857-4af2-9ee8-0b7a58a57151 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.227654 Aug 02 09:12:17.049628 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 388/783] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:16 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:17.964540 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:17.965086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:17.972302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:17.972744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:17.973510 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:17.973987 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.071040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-46f0d87f-6a06-49ac-9359-dc725e203da2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:18.071727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-46f0d87f-6a06-49ac-9359-dc725e203da2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:18.078653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-46f0d87f-6a06-49ac-9359-dc725e203da2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.080556 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-46f0d87f-6a06-49ac-9359-dc725e203da2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.080679 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-46f0d87f-6a06-49ac-9359-dc725e203da2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.081212 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-46f0d87f-6a06-49ac-9359-dc725e203da2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.114505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:18.123350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:18.124878 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:18.126079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a82a13c6-8de4-47cc-97ac-4f09961b812c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.165499 Aug 02 09:12:18.127167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 396/784] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:17 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:18.232589 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-46f0d87f-6a06-49ac-9359-dc725e203da2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:18.240453 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-46f0d87f-6a06-49ac-9359-dc725e203da2 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.173540 Aug 02 09:12:18.241008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 389/785] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:18 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:19.151018 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:19.152878 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:19.161659 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:19.162746 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:19.163750 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:19.164390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:19.262548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-789a717b-b078-49e3-8cdb-488b26032938 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:19.263157 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-789a717b-b078-49e3-8cdb-488b26032938 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:19.270117 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-789a717b-b078-49e3-8cdb-488b26032938 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:19.270788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-789a717b-b078-49e3-8cdb-488b26032938 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:19.272675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-789a717b-b078-49e3-8cdb-488b26032938 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:19.272675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-789a717b-b078-49e3-8cdb-488b26032938 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:19.291124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:19.309236 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:19.318029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:19.319789 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:19.320951 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-01c62ccc-2c4c-4bcc-8c78-94e017e6f299 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.174272 Aug 02 09:12:19.321633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 397/786] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:19 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:19.415719 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-789a717b-b078-49e3-8cdb-488b26032938 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:19.424689 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-789a717b-b078-49e3-8cdb-488b26032938 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.165744 Aug 02 09:12:19.425286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 390/787] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:19 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:20.344550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:20.345732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:20.352264 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.352708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.353462 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.353955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.448088 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8a5014f9-1b6c-4646-9f2d-471995db36ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:20.448853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8a5014f9-1b6c-4646-9f2d-471995db36ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:20.455616 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8a5014f9-1b6c-4646-9f2d-471995db36ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.456148 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8a5014f9-1b6c-4646-9f2d-471995db36ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.456990 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8a5014f9-1b6c-4646-9f2d-471995db36ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.457501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8a5014f9-1b6c-4646-9f2d-471995db36ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.482391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:20.491636 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:20.493175 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:20.494405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-488878cd-b1d3-448e-8cf5-54d0cff181cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.153795 Aug 02 09:12:20.494974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 398/788] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:20 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:20.614457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8a5014f9-1b6c-4646-9f2d-471995db36ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:20.623109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8a5014f9-1b6c-4646-9f2d-471995db36ec tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.178768 Aug 02 09:12:20.623692 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 391/789] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:20 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:21.517120 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:21.517768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:21.524705 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.525166 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.525981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.526417 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.645961 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1b96dd4f-56d5-42b3-bd3f-f00d75f72c28 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:21.647589 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1b96dd4f-56d5-42b3-bd3f-f00d75f72c28 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:21.654335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1b96dd4f-56d5-42b3-bd3f-f00d75f72c28 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.654775 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1b96dd4f-56d5-42b3-bd3f-f00d75f72c28 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.655532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1b96dd4f-56d5-42b3-bd3f-f00d75f72c28 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.655957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1b96dd4f-56d5-42b3-bd3f-f00d75f72c28 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.672650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.681277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.682819 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.683987 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-76b2a59a-8388-4496-868a-f965a076864b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.171278 Aug 02 09:12:21.684551 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 399/790] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:21 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:21.803226 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1b96dd4f-56d5-42b3-bd3f-f00d75f72c28 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.811399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1b96dd4f-56d5-42b3-bd3f-f00d75f72c28 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.170296 Aug 02 09:12:21.811971 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 392/791] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:21 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:22.708253 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:22.708943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:22.711354 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=52 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:22.716361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.722012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.722012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.722012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.833684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b8ef4aa9-735c-4df1-b546-e3bf1a58256b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:22.834409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b8ef4aa9-735c-4df1-b546-e3bf1a58256b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:22.840937 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b8ef4aa9-735c-4df1-b546-e3bf1a58256b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.841390 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b8ef4aa9-735c-4df1-b546-e3bf1a58256b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.842185 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b8ef4aa9-735c-4df1-b546-e3bf1a58256b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.842657 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b8ef4aa9-735c-4df1-b546-e3bf1a58256b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.859575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:22.865909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:22.867642 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:22.868805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0992566a-3977-467a-89fe-4f08f131ad0c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.164466 Aug 02 09:12:22.869364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 400/792] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:22 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:22.990056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b8ef4aa9-735c-4df1-b546-e3bf1a58256b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:22.998177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b8ef4aa9-735c-4df1-b546-e3bf1a58256b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.168964 Aug 02 09:12:23.012371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 393/793] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:22 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:23.892517 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:23.893191 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:23.899772 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:23.900208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:23.900960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:23.901385 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.019697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4e252664-a7e4-4d99-88d5-26398528a53b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:24.020286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4e252664-a7e4-4d99-88d5-26398528a53b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:24.027142 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4e252664-a7e4-4d99-88d5-26398528a53b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.027598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4e252664-a7e4-4d99-88d5-26398528a53b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.028376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4e252664-a7e4-4d99-88d5-26398528a53b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.028813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4e252664-a7e4-4d99-88d5-26398528a53b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.037577 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:24.046171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:24.048336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:24.049528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-456a5883-3d9f-4741-b846-bb39c998d01a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.161144 Aug 02 09:12:24.050118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 401/794] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:23 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:24.180438 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4e252664-a7e4-4d99-88d5-26398528a53b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:24.191490 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4e252664-a7e4-4d99-88d5-26398528a53b tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.175677 Aug 02 09:12:24.192072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 394/795] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:24 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:25.073798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:25.074383 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:25.080845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.081297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.082102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.082539 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.212548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4db17b55-c0bd-4b33-a7ed-516757723cc8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:25.213141 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4db17b55-c0bd-4b33-a7ed-516757723cc8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:25.215626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=50 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:25.217077 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:25.220422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4db17b55-c0bd-4b33-a7ed-516757723cc8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.221008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4db17b55-c0bd-4b33-a7ed-516757723cc8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.221851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4db17b55-c0bd-4b33-a7ed-516757723cc8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.222394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4db17b55-c0bd-4b33-a7ed-516757723cc8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.225492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:25.227037 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:25.230759 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a4e6ab00-2133-4c85-a6f9-c080efe6c73d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.158377 Aug 02 09:12:25.230759 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 402/796] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:25 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:25.373719 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4db17b55-c0bd-4b33-a7ed-516757723cc8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:25.382773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4db17b55-c0bd-4b33-a7ed-516757723cc8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.174016 Aug 02 09:12:25.383369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 395/797] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:25 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:26.252952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:26.253555 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:26.260113 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.260564 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.261338 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.261777 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.396737 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:26.404134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f3355f9b-380f-4336-bdfc-eb9896badf49 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:26.404782 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f3355f9b-380f-4336-bdfc-eb9896badf49 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:26.405516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:26.407062 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:26.408236 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-aa091946-87e2-4436-9d2e-a6ce2f8719ef tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.159637 Aug 02 09:12:26.408809 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 403/798] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:26 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:26.412784 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3355f9b-380f-4336-bdfc-eb9896badf49 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.413243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3355f9b-380f-4336-bdfc-eb9896badf49 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.414062 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3355f9b-380f-4336-bdfc-eb9896badf49 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.414513 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f3355f9b-380f-4336-bdfc-eb9896badf49 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.476468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0d720994-1b85-451a-909e-4c453c0584cb tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:26.476949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0d720994-1b85-451a-909e-4c453c0584cb tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:26.484114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d720994-1b85-451a-909e-4c453c0584cb tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.484565 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d720994-1b85-451a-909e-4c453c0584cb tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.485428 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d720994-1b85-451a-909e-4c453c0584cb tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.485867 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d720994-1b85-451a-909e-4c453c0584cb tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.574019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f3355f9b-380f-4336-bdfc-eb9896badf49 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:26.585926 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f3355f9b-380f-4336-bdfc-eb9896badf49 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.185820 Aug 02 09:12:26.596758 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 396/799] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:26 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:26.620597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-0d720994-1b85-451a-909e-4c453c0584cb tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lazy-loading 'services' on Instance uuid ecd2ae24-eeb6-4170-9d44-990065e9d7bb {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:26.901635 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0d720994-1b85-451a-909e-4c453c0584cb tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb/os-volume_attachments/d4d9ecd9-7b60-4f6f-8905-3f79c5ac8ba9" status: 202 len: 0 microversion: 2.1 time: 0.428905 Aug 02 09:12:26.902267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 404/800] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:12:26 2022] DELETE /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb/os-volume_attachments/d4d9ecd9-7b60-4f6f-8905-3f79c5ac8ba9 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:12:27.436581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:27.437379 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:27.445022 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.445483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.446291 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.446730 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.578286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.587156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.588640 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.589781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-95925350-feff-4125-b5f3-67299034e302 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.157075 Aug 02 09:12:27.590482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 397/801] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:27 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:27.610809 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-77b9f62a-f49b-4575-bdf7-41150240a3e4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:27.636877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-77b9f62a-f49b-4575-bdf7-41150240a3e4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:27.636877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77b9f62a-f49b-4575-bdf7-41150240a3e4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.636877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77b9f62a-f49b-4575-bdf7-41150240a3e4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.636877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77b9f62a-f49b-4575-bdf7-41150240a3e4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.637280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77b9f62a-f49b-4575-bdf7-41150240a3e4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.777670 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-77b9f62a-f49b-4575-bdf7-41150240a3e4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.786517 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-77b9f62a-f49b-4575-bdf7-41150240a3e4 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1759 microversion: 2.1 time: 0.179636 Aug 02 09:12:27.787141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 405/802] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:27 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:28.644001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:28.644601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:28.651243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.651684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.652439 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.652972 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.783832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:28.792985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:28.794525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:28.795683 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-78929ecf-8d50-4a50-856e-dd7c564d4e7e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.155687 Aug 02 09:12:28.796366 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 398/803] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:28 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:28.808739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-80764a1b-d0a1-4d0f-837b-5dd49ab771ad tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:28.809347 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-80764a1b-d0a1-4d0f-837b-5dd49ab771ad tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:28.816065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-80764a1b-d0a1-4d0f-837b-5dd49ab771ad tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.816513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-80764a1b-d0a1-4d0f-837b-5dd49ab771ad tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.817281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-80764a1b-d0a1-4d0f-837b-5dd49ab771ad tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.817714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-80764a1b-d0a1-4d0f-837b-5dd49ab771ad tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.968557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-80764a1b-d0a1-4d0f-837b-5dd49ab771ad tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:28.977187 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-80764a1b-d0a1-4d0f-837b-5dd49ab771ad tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1762 microversion: 2.1 time: 0.172445 Aug 02 09:12:28.977762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 406/804] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:28 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1762 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:29.819244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:29.819842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:29.826538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.826986 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.827776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.828212 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.966319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:29.975428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:29.976929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:29.978130 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cbf20d3b-a321-4769-b8a1-cdcb12f26d81 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.163575 Aug 02 09:12:29.978748 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 399/805] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:29 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:30.150007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0b502517-9d64-4d76-93a6-6160d4bbbe2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:30.150775 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0b502517-9d64-4d76-93a6-6160d4bbbe2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:30.157530 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0b502517-9d64-4d76-93a6-6160d4bbbe2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:30.158611 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0b502517-9d64-4d76-93a6-6160d4bbbe2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.159462 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0b502517-9d64-4d76-93a6-6160d4bbbe2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:30.159901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0b502517-9d64-4d76-93a6-6160d4bbbe2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.190649 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0b502517-9d64-4d76-93a6-6160d4bbbe2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:12:30.504854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0b502517-9d64-4d76-93a6-6160d4bbbe2a tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 204 len: 0 microversion: 2.1 time: 0.358433 Aug 02 09:12:30.505343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 407/806] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:12:30 2022] DELETE /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:12:30.515902 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-536cd18d-f43c-4299-ae25-033dc254bf53 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:30.516510 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-536cd18d-f43c-4299-ae25-033dc254bf53 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:30.523374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-536cd18d-f43c-4299-ae25-033dc254bf53 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:30.523826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-536cd18d-f43c-4299-ae25-033dc254bf53 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.524623 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-536cd18d-f43c-4299-ae25-033dc254bf53 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:30.525182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-536cd18d-f43c-4299-ae25-033dc254bf53 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.664159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-536cd18d-f43c-4299-ae25-033dc254bf53 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:30.673262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-536cd18d-f43c-4299-ae25-033dc254bf53 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1514 microversion: 2.1 time: 0.161388 Aug 02 09:12:30.674037 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 400/807] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:30 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:31.003300 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:31.004128 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:31.010369 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.010813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.011776 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.012823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.176903 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.182083 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:31.186704 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.188248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.190175 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fa1790f2-3016-4645-a87f-85da416f45d3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.191430 Aug 02 09:12:31.190730 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 408/808] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:30 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:31.696105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fab7fdf4-0ce8-4d4e-98f2-a3bd9ea57136 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:31.696682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fab7fdf4-0ce8-4d4e-98f2-a3bd9ea57136 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:31.703494 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fab7fdf4-0ce8-4d4e-98f2-a3bd9ea57136 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.703930 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fab7fdf4-0ce8-4d4e-98f2-a3bd9ea57136 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.704701 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fab7fdf4-0ce8-4d4e-98f2-a3bd9ea57136 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.705147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fab7fdf4-0ce8-4d4e-98f2-a3bd9ea57136 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.840910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fab7fdf4-0ce8-4d4e-98f2-a3bd9ea57136 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.849061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fab7fdf4-0ce8-4d4e-98f2-a3bd9ea57136 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1514 microversion: 2.1 time: 0.157761 Aug 02 09:12:31.849625 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 401/809] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:31 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:32.213269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:32.214105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:32.221283 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.221732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.222525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.222966 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.359525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:32.368362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:32.369879 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:32.371087 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d7d04bce-d046-49bb-9b8a-482de9a939ad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.161782 Aug 02 09:12:32.371652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 409/810] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:32 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:32.870305 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7e88ef67-94a4-4f4c-bd03-4a5fe637f7ab tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:32.870910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7e88ef67-94a4-4f4c-bd03-4a5fe637f7ab tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:32.881735 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e88ef67-94a4-4f4c-bd03-4a5fe637f7ab tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.885095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e88ef67-94a4-4f4c-bd03-4a5fe637f7ab tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.885926 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e88ef67-94a4-4f4c-bd03-4a5fe637f7ab tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.886376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e88ef67-94a4-4f4c-bd03-4a5fe637f7ab tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.017718 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7e88ef67-94a4-4f4c-bd03-4a5fe637f7ab tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.025250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7e88ef67-94a4-4f4c-bd03-4a5fe637f7ab tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1514 microversion: 2.1 time: 0.159311 Aug 02 09:12:33.025815 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 402/811] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:32 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:33.395417 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:33.396022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:33.402717 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.403172 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.403954 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.404388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.539469 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.548215 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.549725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.550923 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1eba9c19-e200-4101-a9ac-a6b06aa6a3c4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.159941 Aug 02 09:12:33.551484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 410/812] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:33 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:34.046821 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-062d2044-d7d4-4dff-97db-0493a3ec9fd2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:34.047406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-062d2044-d7d4-4dff-97db-0493a3ec9fd2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:34.054475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-062d2044-d7d4-4dff-97db-0493a3ec9fd2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.054921 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-062d2044-d7d4-4dff-97db-0493a3ec9fd2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.055674 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-062d2044-d7d4-4dff-97db-0493a3ec9fd2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.056102 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-062d2044-d7d4-4dff-97db-0493a3ec9fd2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.188631 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-062d2044-d7d4-4dff-97db-0493a3ec9fd2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:34.196965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-062d2044-d7d4-4dff-97db-0493a3ec9fd2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1514 microversion: 2.1 time: 0.153879 Aug 02 09:12:34.197465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 403/813] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:34 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:34.574457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:34.575039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:34.581759 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.582237 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.582997 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.583423 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.718434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:34.727639 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:34.729145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:34.730364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-99fabe57-de17-4452-9b7a-6fdd25277764 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.159731 Aug 02 09:12:34.730933 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 411/814] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:34 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:35.217316 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8eb11b05-9ae8-421b-bba2-91152b31940b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:35.217948 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8eb11b05-9ae8-421b-bba2-91152b31940b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:35.224410 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8eb11b05-9ae8-421b-bba2-91152b31940b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.224847 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8eb11b05-9ae8-421b-bba2-91152b31940b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.225603 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8eb11b05-9ae8-421b-bba2-91152b31940b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.226061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8eb11b05-9ae8-421b-bba2-91152b31940b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.359476 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8eb11b05-9ae8-421b-bba2-91152b31940b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.367655 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8eb11b05-9ae8-421b-bba2-91152b31940b tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1514 microversion: 2.1 time: 0.154166 Aug 02 09:12:35.368224 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 404/815] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:35 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:35.754997 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:35.755593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:35.762683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.763138 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.763954 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.764386 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.898847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.907428 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.909450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.910677 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c8a60a1d-9540-48f2-bcd5-1e3f6dbf258c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.160326 Aug 02 09:12:35.911230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 412/816] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:35 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:36.389766 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a87f6669-785e-4028-85ef-6526f9046fbe tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:36.390497 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a87f6669-785e-4028-85ef-6526f9046fbe tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:36.397476 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a87f6669-785e-4028-85ef-6526f9046fbe tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.397969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a87f6669-785e-4028-85ef-6526f9046fbe tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.398748 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a87f6669-785e-4028-85ef-6526f9046fbe tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.399179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a87f6669-785e-4028-85ef-6526f9046fbe tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.533919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a87f6669-785e-4028-85ef-6526f9046fbe tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:36.541417 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a87f6669-785e-4028-85ef-6526f9046fbe tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1514 microversion: 2.1 time: 0.155502 Aug 02 09:12:36.542013 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 405/817] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:36 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:36.934835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:36.935414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:36.943234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.944007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.944490 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.944856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.078080 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.092177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.093671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.094877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8dd28530-fde7-4a84-8f4f-de91c82e2634 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.163943 Aug 02 09:12:37.095437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 413/818] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:36 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:37.562945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0cbf8834-d8bc-4000-9e21-f223b1489da6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:37.563552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0cbf8834-d8bc-4000-9e21-f223b1489da6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:37.570563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0cbf8834-d8bc-4000-9e21-f223b1489da6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.571074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0cbf8834-d8bc-4000-9e21-f223b1489da6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.571888 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0cbf8834-d8bc-4000-9e21-f223b1489da6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.572332 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0cbf8834-d8bc-4000-9e21-f223b1489da6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.709849 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0cbf8834-d8bc-4000-9e21-f223b1489da6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.717720 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0cbf8834-d8bc-4000-9e21-f223b1489da6 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1514 microversion: 2.1 time: 0.158673 Aug 02 09:12:37.718643 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 406/819] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:37 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:38.117729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:38.118643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:38.125102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.125546 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.126318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.126768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.260643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.270111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.271860 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.273013 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5a49dbb4-066b-412b-9495-a7f7e58ec0de tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.159226 Aug 02 09:12:38.273578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 414/820] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:38 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:38.740348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4cce41d5-bfa3-4194-8e64-624390c8e6af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:38.741277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4cce41d5-bfa3-4194-8e64-624390c8e6af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:38.747887 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4cce41d5-bfa3-4194-8e64-624390c8e6af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.748336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4cce41d5-bfa3-4194-8e64-624390c8e6af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.749116 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4cce41d5-bfa3-4194-8e64-624390c8e6af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.749557 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4cce41d5-bfa3-4194-8e64-624390c8e6af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.754266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:38.973854 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4cce41d5-bfa3-4194-8e64-624390c8e6af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.983552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4cce41d5-bfa3-4194-8e64-624390c8e6af tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1514 microversion: 2.1 time: 0.247553 Aug 02 09:12:38.984439 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 407/821] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:38 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:39.296739 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:39.297346 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:39.304417 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.306152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.306152 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.306584 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.401101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-6bb47acf-2a3e-4ddc-96be-afeb1e745ca7 req-cc7df703-4a09-48a6-81ae-ed1350b48c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd2ae24-eeb6-4170-9d44-990065e9d7bb", "name": "network-vif-deleted", "tag": "85370a24-000e-466a-9b33-74fda60c702d"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:39.411438 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-6bb47acf-2a3e-4ddc-96be-afeb1e745ca7 req-cc7df703-4a09-48a6-81ae-ed1350b48c79 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.411878 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-6bb47acf-2a3e-4ddc-96be-afeb1e745ca7 req-cc7df703-4a09-48a6-81ae-ed1350b48c79 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.423414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-6bb47acf-2a3e-4ddc-96be-afeb1e745ca7 req-cc7df703-4a09-48a6-81ae-ed1350b48c79 service nova] Creating event network-vif-deleted:85370a24-000e-466a-9b33-74fda60c702d for instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb on hv-cinder-84713 Aug 02 09:12:39.428956 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-6bb47acf-2a3e-4ddc-96be-afeb1e745ca7 req-cc7df703-4a09-48a6-81ae-ed1350b48c79 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151372 Aug 02 09:12:39.429561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 415/822] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:39.451623 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:39.461167 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:39.462210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:39.463377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-26090ffe-996b-4072-8e3a-f046a636407c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.170737 Aug 02 09:12:39.463944 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 408/823] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:39 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:40.009705 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:40.010425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:40.016570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.017017 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.018355 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.018783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.050982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.051423 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.051893 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lazy-loading 'fault' on Instance uuid ecd2ae24-eeb6-4170-9d44-990065e9d7bb {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:40.095345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd384cbf4943368ee57e868c37d92c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc762f121e46c096aaca327258258c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:40.103376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-55229125-4691-425c-b27e-fab5125a54d2 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 200 len: 1309 microversion: 2.1 time: 0.097791 Aug 02 09:12:40.104039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 416/824] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:40 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:40.488476 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:40.489109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:40.495996 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.496448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.497220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.497654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.634891 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:40.643385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:40.645014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:40.646289 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-085aa3ee-d0eb-4070-866b-089009d0ffb3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.162422 Aug 02 09:12:40.646761 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 409/825] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:40 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:41.124862 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:41.125632 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] [instance: ecd2ae24-eeb6-4170-9d44-990065e9d7bb] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:41.132988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.133460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.134271 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.134883 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.149669 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] HTTP exception thrown: Instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb could not be found. Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Request method failure captured: Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb HTTP/1.1 Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OlsGpvQKC_cyqCq4efJmZXc9yGI7yC8AuzdjrmTsMJS2us9FJYMj6sAmVjBM5-MsHLufBmxYYXSYfnizDxFmmUC_D14tHZmqJLF8LiZbFUlNh8XlSbtsEr4q8NAXAwdsde3_6WxljbviG-xdzK6Fri13j4_Tb-Q6EMoHi3M2eOz5fs Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 76cc762f121e46c096aaca327258258c Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1516523254 Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:12:41.151384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/76cc762f121e46c096aaca327258258c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/76cc762f121e46c096aaca327258258c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_76cc762f121e46c096aaca327258258c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/76cc762f121e46c096aaca327258258c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-VolumesSnapshotTestJSON-1516523254 Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 76cc762f121e46c096aaca327258258c Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1516523254 Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-VolumesSnapshotTestJSON-1516523254-project Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: f1fd384cbf4943368ee57e868c37d92c Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-VolumesSnapshotTestJSON-1516523254-project Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb could not be found. Aug 02 09:12:41.153021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'ecd2ae24-eeb6-4170-9d44-990065e9d7bb'} Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb could not be found. Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:12:41.153955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb could not be found. Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb could not be found. Aug 02 09:12:41.155480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:12:41.156589 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] Returning 404 to user: Instance ecd2ae24-eeb6-4170-9d44-990065e9d7bb could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:12:41.156589 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cea46650-5175-4827-825e-cb7a09691187 tempest-VolumesSnapshotTestJSON-1516523254 tempest-VolumesSnapshotTestJSON-1516523254-project] 10.222.0.46 "GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb" status: 404 len: 111 microversion: 2.1 time: 0.032059 Aug 02 09:12:41.156589 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 417/826] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:41 2022] GET /compute/v2.1/servers/ecd2ae24-eeb6-4170-9d44-990065e9d7bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:12:41.668861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:41.669467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:41.676293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.676748 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.677517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.677990 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.821475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.830054 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.832363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.844874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-102d9693-cf69-4f2f-a49e-43fba294d5f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.168662 Aug 02 09:12:41.844874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 410/827] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:41 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:42.858392 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:42.858995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:42.865424 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.865869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.866699 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.867142 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.999269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.008945 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.010483 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.011653 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-10184a12-b123-436a-85ab-9e6c7e5249a0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.157181 Aug 02 09:12:43.022761 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 418/828] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:42 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:43.377596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-a7a67c3b-e1c1-41d2-8af4-4ecd3d6b6b45 req-062b0e6f-7050-4ecf-908f-c5040da5ea75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c248147-71ed-4f5f-89cc-8ca12974efb4", "name": "network-vif-plugged", "status": "completed", "tag": "27491509-00ef-451e-b2ac-f08e653e8310"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:43.387869 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-a7a67c3b-e1c1-41d2-8af4-4ecd3d6b6b45 req-062b0e6f-7050-4ecf-908f-c5040da5ea75 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.388311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-a7a67c3b-e1c1-41d2-8af4-4ecd3d6b6b45 req-062b0e6f-7050-4ecf-908f-c5040da5ea75 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.399659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-a7a67c3b-e1c1-41d2-8af4-4ecd3d6b6b45 req-062b0e6f-7050-4ecf-908f-c5040da5ea75 service nova] Creating event network-vif-plugged:27491509-00ef-451e-b2ac-f08e653e8310 for instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 on hv-cinder-84713 Aug 02 09:12:43.404746 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-a7a67c3b-e1c1-41d2-8af4-4ecd3d6b6b45 req-062b0e6f-7050-4ecf-908f-c5040da5ea75 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089826 Aug 02 09:12:43.412381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 411/829] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:44.035427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:44.036056 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:44.042815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.043261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.044063 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.044493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.183576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:44.194375 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:44.195750 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:44.196903 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b445b650-b346-4abc-b5ec-7673ecd02a11 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.166117 Aug 02 09:12:44.197454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 419/830] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:44 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:45.223089 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:45.223884 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:45.231042 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:45.231496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:45.232289 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:45.232774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:45.373060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:45.383340 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:45.384825 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:45.386031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-887fd54b-56d9-4441-855c-31e64f89780a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.168799 Aug 02 09:12:45.386578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 412/831] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:45 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:46.408756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:46.409361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:46.415962 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:46.416413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:46.417184 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:46.417621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:46.549588 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:46.558711 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:46.560202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:46.561336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a04e7079-83ea-4f23-afc8-0747084b0df8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.156624 Aug 02 09:12:46.561911 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 420/832] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:46 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:47.585664 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:47.586299 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:47.592937 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.593372 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.594169 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.594636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.721987 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.730509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.732014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.733165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-31df9e55-7b1a-4872-916b-28caebaa60ae tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.152029 Aug 02 09:12:47.733907 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 413/833] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:47 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:48.756461 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:48.757060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:48.763586 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:48.764025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:48.764770 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:48.765193 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:48.898774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:48.907301 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:48.908823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:48.910776 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5074a225-d2be-4f7c-80c4-be8137f3aa12 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.158035 Aug 02 09:12:48.911244 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 421/834] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:48 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:49.934283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:49.935938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:49.943201 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:49.943657 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:49.944438 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:49.944876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:50.087977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:50.096429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:50.098730 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:50.099974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-24a19923-097a-454f-9362-e188ddbb3864 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.170731 Aug 02 09:12:50.100593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 414/835] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:49 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:51.124387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:51.124996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:51.132360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:51.132803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:51.133567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:51.134052 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:51.268335 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:51.276903 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:51.278743 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:51.279891 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b05686c1-3173-4fec-8ae8-bb1a75f4b111 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1806 microversion: 2.20 time: 0.159495 Aug 02 09:12:51.280435 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 422/836] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:51 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:52.304208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:52.304763 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:52.311414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.311866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.312641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.313072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.447634 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:52.459110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:52.460847 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:52.462115 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0dcd24a7-fcff-47bc-8719-afd1ea627b3f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1793 microversion: 2.20 time: 0.162569 Aug 02 09:12:52.462719 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 415/837] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:52 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1793 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:08.276791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:13:08.277506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:13:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:13:15.682565 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:15.683449 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=78 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:15.855380 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-56c3a8de-77bf-4d6e-b3fc-ef0e1333633d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0316c227-22c0-446e-955d-3831f7bfd449"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:15.857805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-56c3a8de-77bf-4d6e-b3fc-ef0e1333633d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:15.863861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56c3a8de-77bf-4d6e-b3fc-ef0e1333633d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.864438 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56c3a8de-77bf-4d6e-b3fc-ef0e1333633d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.865317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56c3a8de-77bf-4d6e-b3fc-ef0e1333633d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.865780 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56c3a8de-77bf-4d6e-b3fc-ef0e1333633d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.739990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-56c3a8de-77bf-4d6e-b3fc-ef0e1333633d tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.062411 Aug 02 09:13:16.740671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 423/838] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:13:15 2022] POST /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments => generated 194 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:41.357108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a4a277f7-7436-4302-a6f9-3304f7d695dc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:41.359358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a4a277f7-7436-4302-a6f9-3304f7d695dc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:41.361662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=41 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:41.362503 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=48 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:41.367674 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a4a277f7-7436-4302-a6f9-3304f7d695dc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.368128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a4a277f7-7436-4302-a6f9-3304f7d695dc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.368946 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a4a277f7-7436-4302-a6f9-3304f7d695dc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.369461 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a4a277f7-7436-4302-a6f9-3304f7d695dc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.393016 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-a4a277f7-7436-4302-a6f9-3304f7d695dc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lazy-loading 'flavor' on Instance uuid b93fca05-bed7-45c7-93fb-47a31cdf58f6 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:13:41.672459 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a4a277f7-7436-4302-a6f9-3304f7d695dc tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/action" status: 200 len: 32 microversion: 2.1 time: 0.318751 Aug 02 09:13:41.673079 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 416/839] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:13:41 2022] POST /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/action => generated 32 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:13:41.683484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f42346ee-670b-4779-99a4-2d35c7e9fdf0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:41.684171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f42346ee-670b-4779-99a4-2d35c7e9fdf0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:41.686937 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:41.687619 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:41.694083 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f42346ee-670b-4779-99a4-2d35c7e9fdf0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.694798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f42346ee-670b-4779-99a4-2d35c7e9fdf0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.696353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f42346ee-670b-4779-99a4-2d35c7e9fdf0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.697212 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f42346ee-670b-4779-99a4-2d35c7e9fdf0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.847910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f42346ee-670b-4779-99a4-2d35c7e9fdf0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.858674 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f42346ee-670b-4779-99a4-2d35c7e9fdf0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.179823 Aug 02 09:13:41.873924 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 424/840] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:41 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:42.882967 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e03c5ff7-1109-4909-84d1-94f7226c1b39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:42.883810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e03c5ff7-1109-4909-84d1-94f7226c1b39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:42.897364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e03c5ff7-1109-4909-84d1-94f7226c1b39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.897364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e03c5ff7-1109-4909-84d1-94f7226c1b39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:42.897364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e03c5ff7-1109-4909-84d1-94f7226c1b39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.897364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e03c5ff7-1109-4909-84d1-94f7226c1b39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.214947 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e03c5ff7-1109-4909-84d1-94f7226c1b39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.225380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e03c5ff7-1109-4909-84d1-94f7226c1b39 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.348475 Aug 02 09:13:43.232812 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 417/841] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:42 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:44.250436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4682c50b-8126-4497-ba14-50b9abd43060 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:44.251055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4682c50b-8126-4497-ba14-50b9abd43060 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:44.259445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4682c50b-8126-4497-ba14-50b9abd43060 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.264223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4682c50b-8126-4497-ba14-50b9abd43060 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.264223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4682c50b-8126-4497-ba14-50b9abd43060 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.264223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4682c50b-8126-4497-ba14-50b9abd43060 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.401650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4682c50b-8126-4497-ba14-50b9abd43060 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:44.410195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4682c50b-8126-4497-ba14-50b9abd43060 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.163860 Aug 02 09:13:44.411112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 425/842] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:44 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:45.433166 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c92c2090-9736-4b29-aa8c-d86f56c00562 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:45.434559 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c92c2090-9736-4b29-aa8c-d86f56c00562 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:45.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c92c2090-9736-4b29-aa8c-d86f56c00562 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.443500 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c92c2090-9736-4b29-aa8c-d86f56c00562 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.444339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c92c2090-9736-4b29-aa8c-d86f56c00562 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.445397 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c92c2090-9736-4b29-aa8c-d86f56c00562 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.675258 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c92c2090-9736-4b29-aa8c-d86f56c00562 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.684479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c92c2090-9736-4b29-aa8c-d86f56c00562 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.255664 Aug 02 09:13:45.685052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 418/843] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:45 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:46.706792 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1924c373-3bf8-48dc-920f-da7173ba0f54 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:46.707425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1924c373-3bf8-48dc-920f-da7173ba0f54 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:46.714886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1924c373-3bf8-48dc-920f-da7173ba0f54 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.715521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1924c373-3bf8-48dc-920f-da7173ba0f54 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.716288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1924c373-3bf8-48dc-920f-da7173ba0f54 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.716713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1924c373-3bf8-48dc-920f-da7173ba0f54 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.767622 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6b234094-3191-4e85-85da-21ddc657626f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Action: 'create', calling method: .version_select at 0x7f0f2d4d0430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-950545340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMYq+9hEVET8n6fY0fAHe4VeyNVInPb1abFFfAuskJXhaWydbJL1/t1OuK+oE488n0ai4Ug/HpKV4LZbm4z2oLSpMAUIxO2CecKDkHd4A9ANX7Mx1Vhx/BGQBj2KiQc/A=="}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:46.784852 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-6b234094-3191-4e85-85da-21ddc657626f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Getting quotas for project d65888d17d2e439592600a4e9305eeed. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:46.790017 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-6b234094-3191-4e85-85da-21ddc657626f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Getting quotas for user 02569c995a6d4b678933599f60ad3909 and project d65888d17d2e439592600a4e9305eeed. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:46.855569 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1924c373-3bf8-48dc-920f-da7173ba0f54 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:46.863483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1924c373-3bf8-48dc-920f-da7173ba0f54 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.160587 Aug 02 09:13:46.864034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 419/844] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:46 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:46.912771 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6b234094-3191-4e85-85da-21ddc657626f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.309208 Aug 02 09:13:46.913584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 426/845] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:13:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:47.884900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b3b2ebd3-8b85-48a5-a218-6d9bf28f2c30 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:47.885616 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b3b2ebd3-8b85-48a5-a218-6d9bf28f2c30 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:47.892414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b3b2ebd3-8b85-48a5-a218-6d9bf28f2c30 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.893024 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b3b2ebd3-8b85-48a5-a218-6d9bf28f2c30 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.894122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b3b2ebd3-8b85-48a5-a218-6d9bf28f2c30 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.894713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b3b2ebd3-8b85-48a5-a218-6d9bf28f2c30 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.053574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b3b2ebd3-8b85-48a5-a218-6d9bf28f2c30 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:48.061553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b3b2ebd3-8b85-48a5-a218-6d9bf28f2c30 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.180790 Aug 02 09:13:48.062147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 420/846] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:47 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:49.084748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0c1ea82d-be0e-4d4c-8566-5f9da21bdbfa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:49.085843 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0c1ea82d-be0e-4d4c-8566-5f9da21bdbfa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:49.103327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c1ea82d-be0e-4d4c-8566-5f9da21bdbfa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:49.112353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c1ea82d-be0e-4d4c-8566-5f9da21bdbfa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:49.112353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c1ea82d-be0e-4d4c-8566-5f9da21bdbfa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:49.112353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c1ea82d-be0e-4d4c-8566-5f9da21bdbfa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:49.415695 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0c1ea82d-be0e-4d4c-8566-5f9da21bdbfa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:49.427727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0c1ea82d-be0e-4d4c-8566-5f9da21bdbfa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.347852 Aug 02 09:13:49.428426 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 427/847] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:49 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:50.451355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-dd3f9db1-778e-479e-be98-c5972ffb7b06 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:50.451962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-dd3f9db1-778e-479e-be98-c5972ffb7b06 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:50.459810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dd3f9db1-778e-479e-be98-c5972ffb7b06 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.460786 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dd3f9db1-778e-479e-be98-c5972ffb7b06 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.461559 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dd3f9db1-778e-479e-be98-c5972ffb7b06 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.462023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dd3f9db1-778e-479e-be98-c5972ffb7b06 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.594835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-dd3f9db1-778e-479e-be98-c5972ffb7b06 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.603955 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-dd3f9db1-778e-479e-be98-c5972ffb7b06 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.156314 Aug 02 09:13:50.604632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 421/848] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:50 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:51.624428 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-efded434-4ad3-45dd-bdb7-1824d04f392f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:51.624967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-efded434-4ad3-45dd-bdb7-1824d04f392f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:51.631865 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-efded434-4ad3-45dd-bdb7-1824d04f392f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.632413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-efded434-4ad3-45dd-bdb7-1824d04f392f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.633362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-efded434-4ad3-45dd-bdb7-1824d04f392f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.633804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-efded434-4ad3-45dd-bdb7-1824d04f392f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.771869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-efded434-4ad3-45dd-bdb7-1824d04f392f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.781404 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-efded434-4ad3-45dd-bdb7-1824d04f392f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.160709 Aug 02 09:13:51.782016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 428/849] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:51 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:51.947953 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e4fce6ec-b520-4131-b90d-d7bfc1ad4c76 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:51.948523 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e4fce6ec-b520-4131-b90d-d7bfc1ad4c76 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:51.955475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4fce6ec-b520-4131-b90d-d7bfc1ad4c76 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.955923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4fce6ec-b520-4131-b90d-d7bfc1ad4c76 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.956687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4fce6ec-b520-4131-b90d-d7bfc1ad4c76 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.957119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4fce6ec-b520-4131-b90d-d7bfc1ad4c76 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.980205 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e4fce6ec-b520-4131-b90d-d7bfc1ad4c76 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43/ips" status: 200 len: 148 microversion: 2.1 time: 0.036542 Aug 02 09:13:51.980755 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 422/850] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:13:51 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:51.992119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b984f723-80e4-4b64-afb3-4f93ff0b9855"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:51.994725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.001642 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.002136 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.002946 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.003383 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.087152 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Invalid volume: volume b984f723-80e4-4b64-afb3-4f93ff0b9855 is already attached to instances: dc22a12f-291a-4c23-add9-09a32ae7202e Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: POST /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43/os-volume_attachments HTTP/1.1 Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 74 Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:13:52.088863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {"volumeAttachment": {"volumeId": "b984f723-80e4-4b64-afb3-4f93ff0b9855"}} Aug 02 09:13:52.090466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Invalid volume: volume b984f723-80e4-4b64-afb3-4f93ff0b9855 is already attached to instances: dc22a12f-291a-4c23-add9-09a32ae7202e Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'server_id': 'dbc844d0-e603-4cbd-9196-ef78031daa43', 'body': {'volumeAttachment': {'volumeId': 'b984f723-80e4-4b64-afb3-4f93ff0b9855'}}} Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b984f723-80e4-4b64-afb3-4f93ff0b9855 is already attached to instances: dc22a12f-291a-4c23-add9-09a32ae7202e Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:52.091273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b984f723-80e4-4b64-afb3-4f93ff0b9855 is already attached to instances: dc22a12f-291a-4c23-add9-09a32ae7202e Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:52.092445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:52.093651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:52.093651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:13:52.093651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:13:52.093651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b984f723-80e4-4b64-afb3-4f93ff0b9855 is already attached to instances: dc22a12f-291a-4c23-add9-09a32ae7202e Aug 02 09:13:52.093651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:52.093651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 400 to user: Invalid volume: volume b984f723-80e4-4b64-afb3-4f93ff0b9855 is already attached to instances: dc22a12f-291a-4c23-add9-09a32ae7202e {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:13:52.093651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-32d007b5-7f97-4e8e-b828-9ecf8ea799bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102107 Aug 02 09:13:52.093651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 429/851] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:13:51 2022] POST /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:13:52.099774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ee0fbbc7-6047-4a8a-b523-18a9be3353b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.100315 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ee0fbbc7-6047-4a8a-b523-18a9be3353b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.106933 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee0fbbc7-6047-4a8a-b523-18a9be3353b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.107376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee0fbbc7-6047-4a8a-b523-18a9be3353b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.108145 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee0fbbc7-6047-4a8a-b523-18a9be3353b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.108569 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ee0fbbc7-6047-4a8a-b523-18a9be3353b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.135113 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ee0fbbc7-6047-4a8a-b523-18a9be3353b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Going to try to terminate instance {{(pid=118368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:13:52.231867 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d57497d0-de8a-49ec-aecf-8dd2da8c4473 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1906213831"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:52.232401 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d57497d0-de8a-49ec-aecf-8dd2da8c4473 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.239125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d57497d0-de8a-49ec-aecf-8dd2da8c4473 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.239570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d57497d0-de8a-49ec-aecf-8dd2da8c4473 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.240332 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d57497d0-de8a-49ec-aecf-8dd2da8c4473 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.240762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d57497d0-de8a-49ec-aecf-8dd2da8c4473 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.376815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.network.security_group_api [None req-d57497d0-de8a-49ec-aecf-8dd2da8c4473 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Removing security group ea373968-ccf7-4f61-8096-cd8e08b613ed from port c42abcac-01a1-4142-811d-f1eb28ab8e79 Aug 02 09:13:52.504902 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ee0fbbc7-6047-4a8a-b523-18a9be3353b9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 204 len: 0 microversion: 2.1 time: 0.408762 Aug 02 09:13:52.505684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 423/852] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:13:52 2022] DELETE /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:13:52.521336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9e1e07d2-8d00-436a-848e-505cbb5d62df tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.522923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9e1e07d2-8d00-436a-848e-505cbb5d62df tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.537532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e1e07d2-8d00-436a-848e-505cbb5d62df tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.538356 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e1e07d2-8d00-436a-848e-505cbb5d62df tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.540303 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e1e07d2-8d00-436a-848e-505cbb5d62df tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.541178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e1e07d2-8d00-436a-848e-505cbb5d62df tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.698094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9e1e07d2-8d00-436a-848e-505cbb5d62df tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:52.706256 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9e1e07d2-8d00-436a-848e-505cbb5d62df tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1680 microversion: 2.1 time: 0.194888 Aug 02 09:13:52.706848 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 424/853] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:52 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:52.803083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a84afbca-e7d9-415b-ad59-0086ee0c73b5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.803638 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a84afbca-e7d9-415b-ad59-0086ee0c73b5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.810856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a84afbca-e7d9-415b-ad59-0086ee0c73b5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.811344 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a84afbca-e7d9-415b-ad59-0086ee0c73b5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.812120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a84afbca-e7d9-415b-ad59-0086ee0c73b5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.812567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a84afbca-e7d9-415b-ad59-0086ee0c73b5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.956831 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a84afbca-e7d9-415b-ad59-0086ee0c73b5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:52.965449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a84afbca-e7d9-415b-ad59-0086ee0c73b5 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.166363 Aug 02 09:13:52.966033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 425/854] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:52 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:53.019749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d57497d0-de8a-49ec-aecf-8dd2da8c4473 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "POST /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/action" status: 202 len: 0 microversion: 2.1 time: 0.894963 Aug 02 09:13:53.020380 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 430/855] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:13:52 2022] POST /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:13:53.099487 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-12c4f6e7-028a-478e-a480-27447cfe8ed0 req-020f95d1-cfdc-4841-9f28-bc285d4e793f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9b683c-91dd-41ab-a9ee-45c9af6dc89b", "tag": "c42abcac-01a1-4142-811d-f1eb28ab8e79"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:53.110505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-12c4f6e7-028a-478e-a480-27447cfe8ed0 req-020f95d1-cfdc-4841-9f28-bc285d4e793f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:53.111047 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-12c4f6e7-028a-478e-a480-27447cfe8ed0 req-020f95d1-cfdc-4841-9f28-bc285d4e793f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.122876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-12c4f6e7-028a-478e-a480-27447cfe8ed0 req-020f95d1-cfdc-4841-9f28-bc285d4e793f service nova] Creating event network-changed:c42abcac-01a1-4142-811d-f1eb28ab8e79 for instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b on hv-cinder-84713 Aug 02 09:13:53.129511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-12c4f6e7-028a-478e-a480-27447cfe8ed0 req-020f95d1-cfdc-4841-9f28-bc285d4e793f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102343 Aug 02 09:13:53.129511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 426/856] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:53.727671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6e4a7a7d-efc6-4cfe-ad1a-852e41a3fd24 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:53.735854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6e4a7a7d-efc6-4cfe-ad1a-852e41a3fd24 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:53.735854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e4a7a7d-efc6-4cfe-ad1a-852e41a3fd24 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:53.735854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e4a7a7d-efc6-4cfe-ad1a-852e41a3fd24 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.735854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e4a7a7d-efc6-4cfe-ad1a-852e41a3fd24 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:53.736246 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6e4a7a7d-efc6-4cfe-ad1a-852e41a3fd24 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.944931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6e4a7a7d-efc6-4cfe-ad1a-852e41a3fd24 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.953194 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6e4a7a7d-efc6-4cfe-ad1a-852e41a3fd24 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1680 microversion: 2.1 time: 0.230107 Aug 02 09:13:53.953774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 431/857] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:53 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:53.990457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-791b04fc-e324-44a5-ae0c-03424793c392 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:53.993447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-791b04fc-e324-44a5-ae0c-03424793c392 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.000523 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-791b04fc-e324-44a5-ae0c-03424793c392 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.000900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-791b04fc-e324-44a5-ae0c-03424793c392 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.001789 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-791b04fc-e324-44a5-ae0c-03424793c392 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.002360 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-791b04fc-e324-44a5-ae0c-03424793c392 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.204060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-791b04fc-e324-44a5-ae0c-03424793c392 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:54.212118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-791b04fc-e324-44a5-ae0c-03424793c392 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.227886 Aug 02 09:13:54.212908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 427/858] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:53 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:54.315350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-30cdfa07-b520-400e-b5b9-a39c7a83569a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:54.315879 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-30cdfa07-b520-400e-b5b9-a39c7a83569a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.321939 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30cdfa07-b520-400e-b5b9-a39c7a83569a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.322401 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30cdfa07-b520-400e-b5b9-a39c7a83569a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.323177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30cdfa07-b520-400e-b5b9-a39c7a83569a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.323693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-30cdfa07-b520-400e-b5b9-a39c7a83569a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.418048 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-30cdfa07-b520-400e-b5b9-a39c7a83569a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lazy-loading 'services' on Instance uuid 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:13:54.658673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-30cdfa07-b520-400e-b5b9-a39c7a83569a tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments/53b42842-50d1-4468-b7bb-16f543c0f862" status: 202 len: 0 microversion: 2.1 time: 0.347397 Aug 02 09:13:54.660294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 432/859] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:13:54 2022] DELETE /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments/53b42842-50d1-4468-b7bb-16f543c0f862 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:13:54.669732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3050ecad-10e5-49cf-b343-493374751586 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:54.672425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3050ecad-10e5-49cf-b343-493374751586 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.679355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3050ecad-10e5-49cf-b343-493374751586 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.679832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3050ecad-10e5-49cf-b343-493374751586 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.681724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3050ecad-10e5-49cf-b343-493374751586 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.682216 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3050ecad-10e5-49cf-b343-493374751586 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.729507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3050ecad-10e5-49cf-b343-493374751586 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063651 Aug 02 09:13:54.734931 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 428/860] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:13:54 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:54.981039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-31ff424d-ec5c-4d73-9afc-045754e05176 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:54.981039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-31ff424d-ec5c-4d73-9afc-045754e05176 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.997867 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-31ff424d-ec5c-4d73-9afc-045754e05176 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.998359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-31ff424d-ec5c-4d73-9afc-045754e05176 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.999190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-31ff424d-ec5c-4d73-9afc-045754e05176 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.999507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-31ff424d-ec5c-4d73-9afc-045754e05176 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.145610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-936fe3e8-ccb4-4470-82e1-97b445c7a25d req-538aa58c-cde6-44d4-be03-c880a53878a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9b683c-91dd-41ab-a9ee-45c9af6dc89b", "tag": "c42abcac-01a1-4142-811d-f1eb28ab8e79"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:55.151681 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-31ff424d-ec5c-4d73-9afc-045754e05176 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.156078 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-936fe3e8-ccb4-4470-82e1-97b445c7a25d req-538aa58c-cde6-44d4-be03-c880a53878a1 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.156567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-936fe3e8-ccb4-4470-82e1-97b445c7a25d req-538aa58c-cde6-44d4-be03-c880a53878a1 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.166566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-31ff424d-ec5c-4d73-9afc-045754e05176 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1680 microversion: 2.1 time: 0.194959 Aug 02 09:13:55.171368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-936fe3e8-ccb4-4470-82e1-97b445c7a25d req-538aa58c-cde6-44d4-be03-c880a53878a1 service nova] Creating event network-changed:c42abcac-01a1-4142-811d-f1eb28ab8e79 for instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b on hv-cinder-84713 Aug 02 09:13:55.179353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 433/861] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:54 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:55.186990 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-936fe3e8-ccb4-4470-82e1-97b445c7a25d req-538aa58c-cde6-44d4-be03-c880a53878a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045979 Aug 02 09:13:55.188146 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 429/862] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:55.236929 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-feb84803-60f4-4b40-9c5c-9f72d4aeb36c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:55.237467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-feb84803-60f4-4b40-9c5c-9f72d4aeb36c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:55.243965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-feb84803-60f4-4b40-9c5c-9f72d4aeb36c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.244503 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-feb84803-60f4-4b40-9c5c-9f72d4aeb36c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.245214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-feb84803-60f4-4b40-9c5c-9f72d4aeb36c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.245643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-feb84803-60f4-4b40-9c5c-9f72d4aeb36c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.420602 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-feb84803-60f4-4b40-9c5c-9f72d4aeb36c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.431657 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-feb84803-60f4-4b40-9c5c-9f72d4aeb36c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.198444 Aug 02 09:13:55.442208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 434/863] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:55 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:55.743234 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fc7879a9-8c4f-4b8b-9290-2b635ce79371 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:55.745609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fc7879a9-8c4f-4b8b-9290-2b635ce79371 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:55.752478 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fc7879a9-8c4f-4b8b-9290-2b635ce79371 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.759474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fc7879a9-8c4f-4b8b-9290-2b635ce79371 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.759474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fc7879a9-8c4f-4b8b-9290-2b635ce79371 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.759474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fc7879a9-8c4f-4b8b-9290-2b635ce79371 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.772338 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:55.786851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fc7879a9-8c4f-4b8b-9290-2b635ce79371 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Aug 02 09:13:55.789973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 430/864] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:13:55 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:56.072170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-0cf93dfd-9db9-406b-b35a-82f2ee27ede2 req-048cc2ea-17c2-4f3e-b4c4-36f78649333a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc844d0-e603-4cbd-9196-ef78031daa43", "name": "network-vif-deleted", "tag": "95b4f3b0-a468-42f5-ae4f-42c268d708d9"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:56.091893 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-0cf93dfd-9db9-406b-b35a-82f2ee27ede2 req-048cc2ea-17c2-4f3e-b4c4-36f78649333a service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.096143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-0cf93dfd-9db9-406b-b35a-82f2ee27ede2 req-048cc2ea-17c2-4f3e-b4c4-36f78649333a service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.109772 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-0cf93dfd-9db9-406b-b35a-82f2ee27ede2 req-048cc2ea-17c2-4f3e-b4c4-36f78649333a service nova] Creating event network-vif-deleted:95b4f3b0-a468-42f5-ae4f-42c268d708d9 for instance dbc844d0-e603-4cbd-9196-ef78031daa43 on hv-cinder-84713 Aug 02 09:13:56.115478 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-0cf93dfd-9db9-406b-b35a-82f2ee27ede2 req-048cc2ea-17c2-4f3e-b4c4-36f78649333a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049295 Aug 02 09:13:56.116452 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 435/865] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:56.195448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d108f34a-9f8c-4c34-ac53-6919dbd42e4c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:56.197289 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d108f34a-9f8c-4c34-ac53-6919dbd42e4c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:56.204652 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d108f34a-9f8c-4c34-ac53-6919dbd42e4c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.205105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d108f34a-9f8c-4c34-ac53-6919dbd42e4c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.206011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d108f34a-9f8c-4c34-ac53-6919dbd42e4c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.206436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d108f34a-9f8c-4c34-ac53-6919dbd42e4c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.279502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d108f34a-9f8c-4c34-ac53-6919dbd42e4c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.287451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d108f34a-9f8c-4c34-ac53-6919dbd42e4c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1613 microversion: 2.1 time: 0.096763 Aug 02 09:13:56.288436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 431/866] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:56 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:56.465004 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-32f1209b-084b-4d5a-902f-3b3013322c5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:56.466447 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-32f1209b-084b-4d5a-902f-3b3013322c5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:56.473319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-32f1209b-084b-4d5a-902f-3b3013322c5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.474045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-32f1209b-084b-4d5a-902f-3b3013322c5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.474990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-32f1209b-084b-4d5a-902f-3b3013322c5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.475576 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-32f1209b-084b-4d5a-902f-3b3013322c5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.661103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-32f1209b-084b-4d5a-902f-3b3013322c5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.671929 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-32f1209b-084b-4d5a-902f-3b3013322c5f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.216887 Aug 02 09:13:56.673085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 436/867] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:56 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:56.800089 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0b3d9952-be2d-4162-ab6d-259a12e7c103 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:56.802495 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0b3d9952-be2d-4162-ab6d-259a12e7c103 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:56.810539 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0b3d9952-be2d-4162-ab6d-259a12e7c103 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.810990 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0b3d9952-be2d-4162-ab6d-259a12e7c103 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.812340 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0b3d9952-be2d-4162-ab6d-259a12e7c103 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.813056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0b3d9952-be2d-4162-ab6d-259a12e7c103 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.846962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0b3d9952-be2d-4162-ab6d-259a12e7c103 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050673 Aug 02 09:13:56.847814 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 432/868] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:13:56 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:13:56.858973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:56.859479 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:56.861439 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=4 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:56.886470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.887214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.888015 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.888443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.005360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] HTTP exception thrown: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b is not attached to volume 53b42842-50d1-4468-b7bb-16f543c0f862 Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Request method failure captured: Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments/53b42842-50d1-4468-b7bb-16f543c0f862 HTTP/1.1 Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OlPx8DbJDFqDsRo9lWKum7foQGV6rYrMIMTRoy_8oPb7Jh8Z3DKS9ENUMxEbiSsi0iceaPU21UffNWqtVFXWmSbkPalLzJaItOuvjzPBv90d3wUvwVAQNSVnUPhr_6QrtzhUJJRsjcvwcj0FHQCT-YlC1o34jqEkAcA1o-ue0t4RLY Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 5132918a404e4b6ab13577698e319630 Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-TestMinimumBasicScenario-1599692024 Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:13:57.013762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5132918a404e4b6ab13577698e319630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5132918a404e4b6ab13577698e319630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5132918a404e4b6ab13577698e319630"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5132918a404e4b6ab13577698e319630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-TestMinimumBasicScenario-1599692024 Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 5132918a404e4b6ab13577698e319630 Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1599692024 Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-TestMinimumBasicScenario-1599692024-project Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 8b2daf470f45422a8c1bd5cf62efdd9e Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-TestMinimumBasicScenario-1599692024-project Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:13:57.015437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b is not attached to volume 53b42842-50d1-4468-b7bb-16f543c0f862 Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'server_id': '8d9b683c-91dd-41ab-a9ee-45c9af6dc89b', 'id': '53b42842-50d1-4468-b7bb-16f543c0f862'} Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 53b42842-50d1-4468-b7bb-16f543c0f862. Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:13:57.016171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b is not attached to volume 53b42842-50d1-4468-b7bb-16f543c0f862 Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b is not attached to volume 53b42842-50d1-4468-b7bb-16f543c0f862 Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:57.019415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Returning 404 to user: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b is not attached to volume 53b42842-50d1-4468-b7bb-16f543c0f862 {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:13:57.021420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ddc04067-5893-4ebe-be2e-2dfa6762667e tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments/53b42842-50d1-4468-b7bb-16f543c0f862" status: 404 len: 154 microversion: 2.1 time: 0.160452 Aug 02 09:13:57.021420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 437/869] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:13:56 2022] DELETE /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b/os-volume_attachments/53b42842-50d1-4468-b7bb-16f543c0f862 => generated 154 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:13:57.308768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:57.310047 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:57.330014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.330534 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.331364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.332271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.372387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.372840 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.373292 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lazy-loading 'fault' on Instance uuid dbc844d0-e603-4cbd-9196-ef78031daa43 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:13:57.418853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.426842 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d9509ae3-52a9-460d-9e74-7f8822ce5492 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 200 len: 1332 microversion: 2.1 time: 0.122031 Aug 02 09:13:57.427410 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 433/870] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:57 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:57.693640 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-325cdab3-1e5c-4bec-98b7-aa1f67675c03 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:57.694194 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-325cdab3-1e5c-4bec-98b7-aa1f67675c03 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:57.701300 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-325cdab3-1e5c-4bec-98b7-aa1f67675c03 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.701744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-325cdab3-1e5c-4bec-98b7-aa1f67675c03 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.702578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-325cdab3-1e5c-4bec-98b7-aa1f67675c03 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.703010 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-325cdab3-1e5c-4bec-98b7-aa1f67675c03 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.847242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-325cdab3-1e5c-4bec-98b7-aa1f67675c03 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.856390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-325cdab3-1e5c-4bec-98b7-aa1f67675c03 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.166888 Aug 02 09:13:57.857004 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 438/871] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:57 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:58.417409 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8aafce61-15c2-4bb6-b6a6-10f4c694536d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.417934 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8aafce61-15c2-4bb6-b6a6-10f4c694536d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:58.424358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8aafce61-15c2-4bb6-b6a6-10f4c694536d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.424802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8aafce61-15c2-4bb6-b6a6-10f4c694536d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.425566 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8aafce61-15c2-4bb6-b6a6-10f4c694536d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.426027 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8aafce61-15c2-4bb6-b6a6-10f4c694536d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.450851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8aafce61-15c2-4bb6-b6a6-10f4c694536d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Going to try to terminate instance {{(pid=118368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:13:58.452596 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.453204 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:58.459228 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.459674 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.460435 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.460872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.474750 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 HTTP/1.1 Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:13:58.476234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:13:58.478399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'dbc844d0-e603-4cbd-9196-ef78031daa43'} Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:13:58.479299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:13:58.482162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:13:58.484025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:13:58.484025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cfa7dad6-663c-4b65-b394-eebd3171a88f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 404 len: 111 microversion: 2.1 time: 0.028893 Aug 02 09:13:58.484025 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 439/872] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:58 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:13:58.487904 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d9d0ae1d-7edc-4ab9-bf87-0a8ea54696ee tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '.version_select at 0x7f0f2d9963a0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.613021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d9d0ae1d-7edc-4ab9-bf87-0a8ea54696ee tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695353741" status: 202 len: 0 microversion: 2.1 time: 0.129389 Aug 02 09:13:58.613919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 440/873] 10.222.0.46 () {58 vars in 1221 bytes} [Tue Aug 2 09:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695353741 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:13:58.794385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8aafce61-15c2-4bb6-b6a6-10f4c694536d tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 204 len: 0 microversion: 2.1 time: 0.380977 Aug 02 09:13:58.794903 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 434/874] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:13:58 2022] DELETE /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:13:58.803911 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ed3d46d0-702d-43b7-807a-d8df33c6c1f8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.804523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ed3d46d0-702d-43b7-807a-d8df33c6c1f8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:58.813303 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ed3d46d0-702d-43b7-807a-d8df33c6c1f8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.813829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ed3d46d0-702d-43b7-807a-d8df33c6c1f8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.814927 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ed3d46d0-702d-43b7-807a-d8df33c6c1f8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.815408 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ed3d46d0-702d-43b7-807a-d8df33c6c1f8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.879794 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8d07802a-fbff-4bb0-911f-dd8a421752a1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.880839 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8d07802a-fbff-4bb0-911f-dd8a421752a1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:58.888089 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8d07802a-fbff-4bb0-911f-dd8a421752a1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.888631 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8d07802a-fbff-4bb0-911f-dd8a421752a1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.889671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8d07802a-fbff-4bb0-911f-dd8a421752a1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.890232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8d07802a-fbff-4bb0-911f-dd8a421752a1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.979779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ed3d46d0-702d-43b7-807a-d8df33c6c1f8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:58.988803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ed3d46d0-702d-43b7-807a-d8df33c6c1f8 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1556 microversion: 2.1 time: 0.189432 Aug 02 09:13:58.989458 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 441/875] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:58 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:59.078190 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8d07802a-fbff-4bb0-911f-dd8a421752a1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:59.081977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8d07802a-fbff-4bb0-911f-dd8a421752a1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.206553 Aug 02 09:13:59.082552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 435/876] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:58 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:59.791123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-43c33103-3e56-41ed-a585-57c345e00465 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:59.791626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-43c33103-3e56-41ed-a585-57c345e00465 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:59.799176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-43c33103-3e56-41ed-a585-57c345e00465 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:59.799628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-43c33103-3e56-41ed-a585-57c345e00465 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:59.800415 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-43c33103-3e56-41ed-a585-57c345e00465 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:59.800855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-43c33103-3e56-41ed-a585-57c345e00465 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:59.889724 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-43c33103-3e56-41ed-a585-57c345e00465 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lazy-loading 'services' on Instance uuid dc22a12f-291a-4c23-add9-09a32ae7202e {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:00.010091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:00.019499 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ad7345c0-b30d-44dd-8368-54332df9bec9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:00.019499 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ad7345c0-b30d-44dd-8368-54332df9bec9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:00.019499 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ad7345c0-b30d-44dd-8368-54332df9bec9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.020203 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ad7345c0-b30d-44dd-8368-54332df9bec9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.020560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ad7345c0-b30d-44dd-8368-54332df9bec9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.021243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ad7345c0-b30d-44dd-8368-54332df9bec9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.128862 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-43c33103-3e56-41ed-a585-57c345e00465 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments/b984f723-80e4-4b64-afb3-4f93ff0b9855" status: 202 len: 0 microversion: 2.1 time: 0.341697 Aug 02 09:14:00.129456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 442/877] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:13:59 2022] DELETE /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments/b984f723-80e4-4b64-afb3-4f93ff0b9855 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:14:00.134492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-87e22903-0b3b-49dd-9f26-66e34b63ba8c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:00.135133 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-87e22903-0b3b-49dd-9f26-66e34b63ba8c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:00.142059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-87e22903-0b3b-49dd-9f26-66e34b63ba8c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.142523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-87e22903-0b3b-49dd-9f26-66e34b63ba8c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.145580 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-87e22903-0b3b-49dd-9f26-66e34b63ba8c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.145580 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-87e22903-0b3b-49dd-9f26-66e34b63ba8c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.165550 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ad7345c0-b30d-44dd-8368-54332df9bec9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.174445 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ad7345c0-b30d-44dd-8368-54332df9bec9 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1556 microversion: 2.1 time: 0.167330 Aug 02 09:14:00.175119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 436/878] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:00 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:00.179701 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-07b7e8a1-2fc7-4d33-b280-82376ac93740 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:00.182675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-07b7e8a1-2fc7-4d33-b280-82376ac93740 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:00.189164 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-07b7e8a1-2fc7-4d33-b280-82376ac93740 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.189859 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-07b7e8a1-2fc7-4d33-b280-82376ac93740 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.190658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-07b7e8a1-2fc7-4d33-b280-82376ac93740 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.191085 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-07b7e8a1-2fc7-4d33-b280-82376ac93740 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.222183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-07b7e8a1-2fc7-4d33-b280-82376ac93740 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045970 Aug 02 09:14:00.223067 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 437/879] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:00 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:00.308101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-87e22903-0b3b-49dd-9f26-66e34b63ba8c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.308101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-87e22903-0b3b-49dd-9f26-66e34b63ba8c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.169471 Aug 02 09:14:00.308101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 443/880] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:00 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:00.814215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-adf955a9-174e-458e-989b-9a89783743f2 req-7135e0db-6b7e-4dca-88ef-560027723bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9b683c-91dd-41ab-a9ee-45c9af6dc89b", "name": "network-vif-deleted", "tag": "c42abcac-01a1-4142-811d-f1eb28ab8e79"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:00.824338 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-adf955a9-174e-458e-989b-9a89783743f2 req-7135e0db-6b7e-4dca-88ef-560027723bb7 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.824777 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-adf955a9-174e-458e-989b-9a89783743f2 req-7135e0db-6b7e-4dca-88ef-560027723bb7 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.835603 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-adf955a9-174e-458e-989b-9a89783743f2 req-7135e0db-6b7e-4dca-88ef-560027723bb7 service nova] Creating event network-vif-deleted:c42abcac-01a1-4142-811d-f1eb28ab8e79 for instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b on hv-cinder-84713 Aug 02 09:14:00.841031 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-adf955a9-174e-458e-989b-9a89783743f2 req-7135e0db-6b7e-4dca-88ef-560027723bb7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030391 Aug 02 09:14:00.841627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 438/881] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:01.199631 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1742a409-722b-4795-8843-98985dc93210 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:01.201213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1742a409-722b-4795-8843-98985dc93210 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:01.208379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1742a409-722b-4795-8843-98985dc93210 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.208900 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1742a409-722b-4795-8843-98985dc93210 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.209758 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1742a409-722b-4795-8843-98985dc93210 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.210307 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1742a409-722b-4795-8843-98985dc93210 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.237648 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e1c90171-ea23-40bd-967b-0dfd927a8119 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:01.240447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e1c90171-ea23-40bd-967b-0dfd927a8119 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:01.247631 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e1c90171-ea23-40bd-967b-0dfd927a8119 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.248119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e1c90171-ea23-40bd-967b-0dfd927a8119 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.248974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e1c90171-ea23-40bd-967b-0dfd927a8119 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.249555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e1c90171-ea23-40bd-967b-0dfd927a8119 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.284169 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e1c90171-ea23-40bd-967b-0dfd927a8119 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051732 Aug 02 09:14:01.284763 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 439/882] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:01 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:01.292677 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1742a409-722b-4795-8843-98985dc93210 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2daf470f45422a8c1bd5cf62efdd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5132918a404e4b6ab13577698e319630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:01.300750 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1742a409-722b-4795-8843-98985dc93210 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 200 len: 1344 microversion: 2.1 time: 0.107979 Aug 02 09:14:01.301324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 444/883] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:01 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 1344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:01.327889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2e782a3a-b307-4158-bb79-7f653c3b4cb8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:01.328395 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2e782a3a-b307-4158-bb79-7f653c3b4cb8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:01.334837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e782a3a-b307-4158-bb79-7f653c3b4cb8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.335240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e782a3a-b307-4158-bb79-7f653c3b4cb8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.336008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e782a3a-b307-4158-bb79-7f653c3b4cb8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.336527 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e782a3a-b307-4158-bb79-7f653c3b4cb8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.470077 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2e782a3a-b307-4158-bb79-7f653c3b4cb8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:01.478867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2e782a3a-b307-4158-bb79-7f653c3b4cb8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.155012 Aug 02 09:14:01.479516 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 440/884] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:01 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:02.297437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e44ed1b1-39cf-44b4-b4c1-2883bff6b32c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.299239 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e44ed1b1-39cf-44b4-b4c1-2883bff6b32c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:02.307920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e44ed1b1-39cf-44b4-b4c1-2883bff6b32c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.308377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e44ed1b1-39cf-44b4-b4c1-2883bff6b32c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.309159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e44ed1b1-39cf-44b4-b4c1-2883bff6b32c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.309598 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e44ed1b1-39cf-44b4-b4c1-2883bff6b32c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.323627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.324332 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] [instance: 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:02.331507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.331959 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.332741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.333174 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.343017 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e44ed1b1-39cf-44b4-b4c1-2883bff6b32c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050261 Aug 02 09:14:02.343597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 445/885] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:02 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:14:02.348468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] HTTP exception thrown: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b could not be found. Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Request method failure captured: Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b HTTP/1.1 Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OlPx8DbJDFqDsRo9lWKum7foQGV6rYrMIMTRoy_8oPb7Jh8Z3DKS9ENUMxEbiSsi0iceaPU21UffNWqtVFXWmSbkPalLzJaItOuvjzPBv90d3wUvwVAQNSVnUPhr_6QrtzhUJJRsjcvwcj0FHQCT-YlC1o34jqEkAcA1o-ue0t4RLY Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 5132918a404e4b6ab13577698e319630 Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-TestMinimumBasicScenario-1599692024 Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:14:02.352745 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5132918a404e4b6ab13577698e319630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5132918a404e4b6ab13577698e319630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5132918a404e4b6ab13577698e319630"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5132918a404e4b6ab13577698e319630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-TestMinimumBasicScenario-1599692024 Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 5132918a404e4b6ab13577698e319630 Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1599692024 Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-TestMinimumBasicScenario-1599692024-project Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 8b2daf470f45422a8c1bd5cf62efdd9e Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-TestMinimumBasicScenario-1599692024-project Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b could not be found. Aug 02 09:14:02.354935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '8d9b683c-91dd-41ab-a9ee-45c9af6dc89b'} Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b could not be found. Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:02.355852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b could not be found. Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b could not be found. Aug 02 09:14:02.357374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:02.358727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Returning 404 to user: Instance 8d9b683c-91dd-41ab-a9ee-45c9af6dc89b could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:02.358727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8ae0efe6-e754-462a-b75c-81827fef6dcb tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b" status: 404 len: 111 microversion: 2.1 time: 0.032355 Aug 02 09:14:02.358727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 441/886] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:02 2022] GET /compute/v2.1/servers/8d9b683c-91dd-41ab-a9ee-45c9af6dc89b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:14:02.364487 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-88ce87ac-1b4c-4439-9d8c-6219ef4cc815 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] Calling method '.version_select at 0x7f0f2d580670>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.411931 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-018f918b-0bff-4021-96f4-619f696a55ff tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.412426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-018f918b-0bff-4021-96f4-619f696a55ff tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:02.418555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-018f918b-0bff-4021-96f4-619f696a55ff tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.419037 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-018f918b-0bff-4021-96f4-619f696a55ff tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.419972 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-018f918b-0bff-4021-96f4-619f696a55ff tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.420462 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-018f918b-0bff-4021-96f4-619f696a55ff tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.446506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-018f918b-0bff-4021-96f4-619f696a55ff tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Going to try to terminate instance {{(pid=118368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:14:02.466097 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-88ce87ac-1b4c-4439-9d8c-6219ef4cc815 tempest-TestMinimumBasicScenario-1599692024 tempest-TestMinimumBasicScenario-1599692024-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1453616988" status: 202 len: 0 microversion: 2.1 time: 0.105313 Aug 02 09:14:02.466911 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 446/887] 10.222.0.46 () {58 vars in 1272 bytes} [Tue Aug 2 09:14:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1453616988 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:14:02.502285 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e4126e26-df74-4a87-87b6-653445246c35 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.504110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e4126e26-df74-4a87-87b6-653445246c35 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:02.510036 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4126e26-df74-4a87-87b6-653445246c35 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.510488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4126e26-df74-4a87-87b6-653445246c35 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.511272 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4126e26-df74-4a87-87b6-653445246c35 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.511746 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e4126e26-df74-4a87-87b6-653445246c35 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.653264 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e4126e26-df74-4a87-87b6-653445246c35 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:02.661547 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e4126e26-df74-4a87-87b6-653445246c35 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.163166 Aug 02 09:14:02.662138 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 447/888] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:02 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:02.767868 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-018f918b-0bff-4021-96f4-619f696a55ff tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 204 len: 0 microversion: 2.1 time: 0.360419 Aug 02 09:14:02.768454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 442/889] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:14:02 2022] DELETE /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:14:02.776833 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cbe2bbc6-4251-4c03-9666-534e42730c00 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.777475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cbe2bbc6-4251-4c03-9666-534e42730c00 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:02.783642 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cbe2bbc6-4251-4c03-9666-534e42730c00 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.784238 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cbe2bbc6-4251-4c03-9666-534e42730c00 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.785016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cbe2bbc6-4251-4c03-9666-534e42730c00 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.785460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cbe2bbc6-4251-4c03-9666-534e42730c00 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.925653 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-cbe2bbc6-4251-4c03-9666-534e42730c00 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:02.934143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cbe2bbc6-4251-4c03-9666-534e42730c00 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1679 microversion: 2.1 time: 0.161301 Aug 02 09:14:02.934938 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 448/890] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:02 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:03.683486 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d28d4e1c-aa46-4478-bd21-1deca0237de1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:03.686491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d28d4e1c-aa46-4478-bd21-1deca0237de1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:03.691621 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d28d4e1c-aa46-4478-bd21-1deca0237de1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:03.691808 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d28d4e1c-aa46-4478-bd21-1deca0237de1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:03.693379 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d28d4e1c-aa46-4478-bd21-1deca0237de1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:03.693820 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d28d4e1c-aa46-4478-bd21-1deca0237de1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:03.841638 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d28d4e1c-aa46-4478-bd21-1deca0237de1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:03.850063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d28d4e1c-aa46-4478-bd21-1deca0237de1 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.170672 Aug 02 09:14:03.850636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 443/891] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:03 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:03.956282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-22725b83-479f-4b3a-ae5e-049b5581425d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:03.956903 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-22725b83-479f-4b3a-ae5e-049b5581425d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:03.963925 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22725b83-479f-4b3a-ae5e-049b5581425d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:03.964378 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22725b83-479f-4b3a-ae5e-049b5581425d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:03.965186 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22725b83-479f-4b3a-ae5e-049b5581425d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:03.965619 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-22725b83-479f-4b3a-ae5e-049b5581425d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:04.098765 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-22725b83-479f-4b3a-ae5e-049b5581425d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:04.110294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-22725b83-479f-4b3a-ae5e-049b5581425d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1679 microversion: 2.1 time: 0.157730 Aug 02 09:14:04.111208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 449/892] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:03 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:04.872422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9d01ff39-95b1-4df9-9c3c-ca09efccd9f9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:04.878715 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9d01ff39-95b1-4df9-9c3c-ca09efccd9f9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:04.879809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d01ff39-95b1-4df9-9c3c-ca09efccd9f9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:04.880265 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d01ff39-95b1-4df9-9c3c-ca09efccd9f9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:04.881065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d01ff39-95b1-4df9-9c3c-ca09efccd9f9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:04.881504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d01ff39-95b1-4df9-9c3c-ca09efccd9f9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:05.132302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-542c6550-52a9-4f05-b081-6122c859f488 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:05.132930 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-542c6550-52a9-4f05-b081-6122c859f488 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:05.139461 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-542c6550-52a9-4f05-b081-6122c859f488 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:05.139905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-542c6550-52a9-4f05-b081-6122c859f488 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:05.141336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-542c6550-52a9-4f05-b081-6122c859f488 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:05.141336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-542c6550-52a9-4f05-b081-6122c859f488 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:05.275216 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-542c6550-52a9-4f05-b081-6122c859f488 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:05.283121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-542c6550-52a9-4f05-b081-6122c859f488 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1679 microversion: 2.1 time: 0.154775 Aug 02 09:14:05.283781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 450/893] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:05 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:05.334473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9d01ff39-95b1-4df9-9c3c-ca09efccd9f9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:05.338992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:05.348873 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9d01ff39-95b1-4df9-9c3c-ca09efccd9f9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.476370 Aug 02 09:14:05.358544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 444/894] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:04 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:06.036601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-4bf6c472-8acd-451d-af17-2b817c71255b req-6afc0843-5d0c-4fb4-9eb9-dca9c89bd528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc22a12f-291a-4c23-add9-09a32ae7202e", "name": "network-vif-deleted", "tag": "9c3cf01f-81d0-4a72-b4fb-cf0e71bc6406"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:06.046456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-4bf6c472-8acd-451d-af17-2b817c71255b req-6afc0843-5d0c-4fb4-9eb9-dca9c89bd528 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.046889 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-4bf6c472-8acd-451d-af17-2b817c71255b req-6afc0843-5d0c-4fb4-9eb9-dca9c89bd528 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.058875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-4bf6c472-8acd-451d-af17-2b817c71255b req-6afc0843-5d0c-4fb4-9eb9-dca9c89bd528 service nova] Creating event network-vif-deleted:9c3cf01f-81d0-4a72-b4fb-cf0e71bc6406 for instance dc22a12f-291a-4c23-add9-09a32ae7202e on hv-cinder-84713 Aug 02 09:14:06.063786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-4bf6c472-8acd-451d-af17-2b817c71255b req-6afc0843-5d0c-4fb4-9eb9-dca9c89bd528 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030870 Aug 02 09:14:06.064631 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 451/895] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:06.304793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fcd77979-54ef-4ca8-af99-3cb4f253d845 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:06.305999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fcd77979-54ef-4ca8-af99-3cb4f253d845 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:06.327043 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fcd77979-54ef-4ca8-af99-3cb4f253d845 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.328363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fcd77979-54ef-4ca8-af99-3cb4f253d845 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.329420 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fcd77979-54ef-4ca8-af99-3cb4f253d845 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.330104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fcd77979-54ef-4ca8-af99-3cb4f253d845 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.366151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-58dcad6d-9fca-43da-b56c-bb46d7aa2481 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:06.367543 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-58dcad6d-9fca-43da-b56c-bb46d7aa2481 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:06.375534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58dcad6d-9fca-43da-b56c-bb46d7aa2481 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.376475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58dcad6d-9fca-43da-b56c-bb46d7aa2481 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.377629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58dcad6d-9fca-43da-b56c-bb46d7aa2481 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.378442 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58dcad6d-9fca-43da-b56c-bb46d7aa2481 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.450817 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fcd77979-54ef-4ca8-af99-3cb4f253d845 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:06.481915 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fcd77979-54ef-4ca8-af99-3cb4f253d845 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1612 microversion: 2.1 time: 0.175350 Aug 02 09:14:06.481915 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 445/896] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:06 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1612 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:06.534959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-58dcad6d-9fca-43da-b56c-bb46d7aa2481 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:06.545222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-58dcad6d-9fca-43da-b56c-bb46d7aa2481 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.183647 Aug 02 09:14:06.546060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 452/897] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:06 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:07.500179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:07.500796 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:07.510394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.510847 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.511629 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.513599 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.547928 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.548387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.549018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lazy-loading 'fault' on Instance uuid dc22a12f-291a-4c23-add9-09a32ae7202e {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:07.569661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e478f88a-cff7-4f51-bfad-55b56b9189bf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:07.570581 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e478f88a-cff7-4f51-bfad-55b56b9189bf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:07.576663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e478f88a-cff7-4f51-bfad-55b56b9189bf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.577116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e478f88a-cff7-4f51-bfad-55b56b9189bf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.577913 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e478f88a-cff7-4f51-bfad-55b56b9189bf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.578352 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e478f88a-cff7-4f51-bfad-55b56b9189bf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.597993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:07.606185 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a6279851-5c63-4368-ab31-679308f9eaed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 200 len: 1331 microversion: 2.1 time: 0.110226 Aug 02 09:14:07.608823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 446/898] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:07 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:07.710370 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e478f88a-cff7-4f51-bfad-55b56b9189bf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:07.719091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e478f88a-cff7-4f51-bfad-55b56b9189bf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1733 microversion: 2.1 time: 0.156084 Aug 02 09:14:07.719560 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 453/899] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:07 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:08.631369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:08.632056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:08.639451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:08.640103 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:08.641624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:08.641624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:08.655365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e HTTP/1.1 Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:14:08.657039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:14:08.658637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'dc22a12f-291a-4c23-add9-09a32ae7202e'} Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:08.659525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:14:08.661011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:14:08.664484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:08.664484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-29197aad-64a2-4e6e-916e-651da76edba7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 404 len: 111 microversion: 2.1 time: 0.034263 Aug 02 09:14:08.664484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 447/900] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:08 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:14:08.667556 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cb272e71-6555-4020-8d38-b50d474ebac4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '.version_select at 0x7f0f2d580ca0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:08.740768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-98e01943-0614-4cd8-b6d9-51bb8b13b3fa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:08.740984 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cb272e71-6555-4020-8d38-b50d474ebac4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-222738723" status: 202 len: 0 microversion: 2.1 time: 0.076773 Aug 02 09:14:08.741394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-98e01943-0614-4cd8-b6d9-51bb8b13b3fa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:08.745544 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 454/901] 10.222.0.46 () {58 vars in 1218 bytes} [Tue Aug 2 09:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-222738723 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:14:08.753162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-98e01943-0614-4cd8-b6d9-51bb8b13b3fa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:08.753636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-98e01943-0614-4cd8-b6d9-51bb8b13b3fa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:08.754487 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-98e01943-0614-4cd8-b6d9-51bb8b13b3fa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:08.754921 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-98e01943-0614-4cd8-b6d9-51bb8b13b3fa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:08.954830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-98e01943-0614-4cd8-b6d9-51bb8b13b3fa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:08.963687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-98e01943-0614-4cd8-b6d9-51bb8b13b3fa tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1713 microversion: 2.1 time: 0.226819 Aug 02 09:14:08.964802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 448/902] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:08 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1713 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:09.128308 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:09.128803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:09.135125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.135575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.136350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.136787 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.221110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] HTTP exception thrown: Cannot 'detach_volume' instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 while it is in vm_state rescued Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Request method failure captured: Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments/0316c227-22c0-446e-955d-3831f7bfd449 HTTP/1.1 Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkUtiZTGQAKR0dnal4vCTJhYWvzTPJv-sAIuyoSTn45EtNUdfqxAymXsvlQ2XliECiosiusjoT-xAJPEVdetmgxFh17XLW49kaAKo2J-oUceW7KA8uCZueHdpSeFK8W79HENaYFsQLGqtE4eO-1Lf0taojSxSbXWPVAggEdLBKn6t8 Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:14:09.223454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_259e864bb08645c79dfab23aa56d8822"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 7fd6b148658e4c2884a32f66326833b6 Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:14:09.228550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Cannot 'detach_volume' instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 while it is in vm_state rescued Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'server_id': 'b93fca05-bed7-45c7-93fb-47a31cdf58f6', 'id': '0316c227-22c0-446e-955d-3831f7bfd449'} Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:09.229416 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 while it is in vm_state rescued Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 while it is in vm_state rescued Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:09.230993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Returning 409 to user: Cannot 'detach_volume' instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 while it is in vm_state rescued {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:09.232206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-37a9fdd8-e995-4eee-827d-22afb3781016 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments/0316c227-22c0-446e-955d-3831f7bfd449" status: 409 len: 152 microversion: 2.1 time: 0.100346 Aug 02 09:14:09.232206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 455/903] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:14:09 2022] DELETE /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments/0316c227-22c0-446e-955d-3831f7bfd449 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 09:14:09.237523 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f9ff148d-bcf9-4636-b658-16da3ae79c78 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:09.238635 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f9ff148d-bcf9-4636-b658-16da3ae79c78 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:09.245233 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f9ff148d-bcf9-4636-b658-16da3ae79c78 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.245677 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f9ff148d-bcf9-4636-b658-16da3ae79c78 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.246529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f9ff148d-bcf9-4636-b658-16da3ae79c78 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.246954 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f9ff148d-bcf9-4636-b658-16da3ae79c78 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.445903 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f9ff148d-bcf9-4636-b658-16da3ae79c78 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "POST /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/action" status: 202 len: 0 microversion: 2.1 time: 0.212052 Aug 02 09:14:09.446573 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 449/904] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:14:09 2022] POST /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:14:09.456739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-23952496-959b-40ee-b0a3-d02bad622e0a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:09.456739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-23952496-959b-40ee-b0a3-d02bad622e0a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:09.464849 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23952496-959b-40ee-b0a3-d02bad622e0a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.465304 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23952496-959b-40ee-b0a3-d02bad622e0a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.466133 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23952496-959b-40ee-b0a3-d02bad622e0a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.466575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23952496-959b-40ee-b0a3-d02bad622e0a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.763285 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-23952496-959b-40ee-b0a3-d02bad622e0a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:09.772019 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-23952496-959b-40ee-b0a3-d02bad622e0a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1721 microversion: 2.1 time: 0.320282 Aug 02 09:14:09.773102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 456/905] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:09 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:10.345289 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a3d1c062-6d90-4045-a8fb-7b3dcd7fdc85 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: .version_select at 0x7f0f31effaf0>, body: {"keypair": {"name": "tempest-keypair-257507973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhefWEHu+Qw23ATwhiv5ulKg2o3s0rCq/Y2XJ+EO/HPkCWEk1YnPg7xC0/gCH3fMSHHxLl8aqyd/ePAhfLh59zsjmM88L9+kCVpILG+VwSifdiQrrnuRoxydJLjW2dacA=="}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:10.361087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-a3d1c062-6d90-4045-a8fb-7b3dcd7fdc85 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for project b9df882a572a4bed8966779e50eb7e7c. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:10.365100 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-a3d1c062-6d90-4045-a8fb-7b3dcd7fdc85 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for user 806f0c03435e4c5daeadaa4eb437d936 and project b9df882a572a4bed8966779e50eb7e7c. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:10.374722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:10.469271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a3d1c062-6d90-4045-a8fb-7b3dcd7fdc85 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128351 Aug 02 09:14:10.469878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 450/906] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:14:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:10.793909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-95a5f5a6-c606-407f-b584-fcd45fc62c52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:10.794519 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-95a5f5a6-c606-407f-b584-fcd45fc62c52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:10.802371 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95a5f5a6-c606-407f-b584-fcd45fc62c52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:10.803120 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95a5f5a6-c606-407f-b584-fcd45fc62c52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:10.803948 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95a5f5a6-c606-407f-b584-fcd45fc62c52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:10.805152 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95a5f5a6-c606-407f-b584-fcd45fc62c52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:11.010163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-95a5f5a6-c606-407f-b584-fcd45fc62c52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:11.018926 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-95a5f5a6-c606-407f-b584-fcd45fc62c52 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1721 microversion: 2.1 time: 0.229371 Aug 02 09:14:11.019478 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 457/907] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:10 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:12.041446 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-be73bfb9-d687-4b6f-8fac-c953a9f4188b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:12.042393 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-be73bfb9-d687-4b6f-8fac-c953a9f4188b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:12.050430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be73bfb9-d687-4b6f-8fac-c953a9f4188b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.051125 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be73bfb9-d687-4b6f-8fac-c953a9f4188b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.052370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be73bfb9-d687-4b6f-8fac-c953a9f4188b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.052908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be73bfb9-d687-4b6f-8fac-c953a9f4188b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.224261 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-be73bfb9-d687-4b6f-8fac-c953a9f4188b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:12.232605 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-be73bfb9-d687-4b6f-8fac-c953a9f4188b tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1721 microversion: 2.1 time: 0.195647 Aug 02 09:14:12.233392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 451/908] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:12 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:12.236815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-76720dda-9478-479f-aa4c-407bc5f3e4ce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:12.237786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-76720dda-9478-479f-aa4c-407bc5f3e4ce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:12.245269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76720dda-9478-479f-aa4c-407bc5f3e4ce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.245968 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76720dda-9478-479f-aa4c-407bc5f3e4ce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.246951 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76720dda-9478-479f-aa4c-407bc5f3e4ce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.247561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-76720dda-9478-479f-aa4c-407bc5f3e4ce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.282292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-76720dda-9478-479f-aa4c-407bc5f3e4ce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments/63359b8e-3274-4565-8cbe-4fd7460f2f0e" status: 200 len: 194 microversion: 2.20 time: 0.049229 Aug 02 09:14:12.289790 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 458/909] 10.222.0.46 () {60 vars in 1454 bytes} [Tue Aug 2 09:14:12 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments/63359b8e-3274-4565-8cbe-4fd7460f2f0e => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:14:12.366050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7f774a26-e44c-44f8-b500-b92b4616965a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:12.367605 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7f774a26-e44c-44f8-b500-b92b4616965a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:12.377446 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7f774a26-e44c-44f8-b500-b92b4616965a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.378178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7f774a26-e44c-44f8-b500-b92b4616965a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.379056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7f774a26-e44c-44f8-b500-b92b4616965a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.379590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7f774a26-e44c-44f8-b500-b92b4616965a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.496601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-7f774a26-e44c-44f8-b500-b92b4616965a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lazy-loading 'services' on Instance uuid 6c248147-71ed-4f5f-89cc-8ca12974efb4 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:12.748266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7f774a26-e44c-44f8-b500-b92b4616965a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments/63359b8e-3274-4565-8cbe-4fd7460f2f0e" status: 202 len: 0 microversion: 2.20 time: 0.385933 Aug 02 09:14:12.754747 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 452/910] 10.222.0.46 () {60 vars in 1457 bytes} [Tue Aug 2 09:14:12 2022] DELETE /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments/63359b8e-3274-4565-8cbe-4fd7460f2f0e => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:14:12.758504 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1f68f05e-ff6f-421d-ad57-b11be87fc623 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:12.760785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1f68f05e-ff6f-421d-ad57-b11be87fc623 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:12.769013 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f68f05e-ff6f-421d-ad57-b11be87fc623 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.769756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f68f05e-ff6f-421d-ad57-b11be87fc623 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.770564 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f68f05e-ff6f-421d-ad57-b11be87fc623 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.771007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f68f05e-ff6f-421d-ad57-b11be87fc623 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.806956 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1f68f05e-ff6f-421d-ad57-b11be87fc623 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053474 Aug 02 09:14:12.807791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 459/911] 10.222.0.46 () {60 vars in 1343 bytes} [Tue Aug 2 09:14:12 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:14:13.247892 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-584426299", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "406c2791-4e79-4511-a29d-6d14a120682a"}], "security_groups": [{"name": "tempest-securitygroup--775319913"}], "key_name": "tempest-keypair-257507973", "user_data": "}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:13.266458 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a1edc7b3-9802-4ee7-9695-80ee2565edb4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:13.268562 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a1edc7b3-9802-4ee7-9695-80ee2565edb4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:13.278856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a1edc7b3-9802-4ee7-9695-80ee2565edb4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.278856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a1edc7b3-9802-4ee7-9695-80ee2565edb4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.278856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a1edc7b3-9802-4ee7-9695-80ee2565edb4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.278856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a1edc7b3-9802-4ee7-9695-80ee2565edb4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.382838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] validate_networks() for [('406c2791-4e79-4511-a29d-6d14a120682a', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:14:13.430960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a1edc7b3-9802-4ee7-9695-80ee2565edb4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:13.447914 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a1edc7b3-9802-4ee7-9695-80ee2565edb4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1721 microversion: 2.1 time: 0.190823 Aug 02 09:14:13.469184 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 460/912] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:13 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:13.819134 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-58e9dafb-5b5a-4a5d-8d33-2e50d2547de4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:13.821851 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-58e9dafb-5b5a-4a5d-8d33-2e50d2547de4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:13.827967 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58e9dafb-5b5a-4a5d-8d33-2e50d2547de4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.828397 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58e9dafb-5b5a-4a5d-8d33-2e50d2547de4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.829164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58e9dafb-5b5a-4a5d-8d33-2e50d2547de4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.829593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58e9dafb-5b5a-4a5d-8d33-2e50d2547de4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.858830 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-58e9dafb-5b5a-4a5d-8d33-2e50d2547de4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043578 Aug 02 09:14:13.859543 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 461/913] 10.222.0.46 () {60 vars in 1343 bytes} [Tue Aug 2 09:14:13 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:14:14.020478 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:14:14.020925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:14:14.021610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:14:14.022214 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:14:14.022627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:14:14.032782 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.033320 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.034378 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.034813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.042309 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1367394601", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-950545340", "security_groups": [{"name": "tempest-secgroup-smoke-1305715777"}], "block_device_mapping_v2": [{"uuid": "c4e329ec-9f5c-47ce-8524-06432371b7b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "341e5912-5743-40e5-8ad1-cb9e084387ea"}]}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:14.058586 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for project b9df882a572a4bed8966779e50eb7e7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:14.063361 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for user 806f0c03435e4c5daeadaa4eb437d936 and project b9df882a572a4bed8966779e50eb7e7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:14.080140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:14:14.082679 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:14:14.159494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] validate_networks() for [('341e5912-5743-40e5-8ad1-cb9e084387ea', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:14:14.181851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3e717bab-751f-4e55-8f57-082421eee0ac tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.939077 Aug 02 09:14:14.183102 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 453/914] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:14:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:14:14.194861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6fc0453f-3fb9-4916-a398-80878ba01cca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:14.196044 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6fc0453f-3fb9-4916-a398-80878ba01cca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:14.259392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6fc0453f-3fb9-4916-a398-80878ba01cca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:14.266459 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6fc0453f-3fb9-4916-a398-80878ba01cca tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1240 microversion: 2.1 time: 0.076261 Aug 02 09:14:14.267026 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 454/915] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:14 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:14.377822 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:14.477130 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-80f78efd-b64c-4270-9b2e-5bd8d1cc921e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:14.478047 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-80f78efd-b64c-4270-9b2e-5bd8d1cc921e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:14.484977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-80f78efd-b64c-4270-9b2e-5bd8d1cc921e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.485596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-80f78efd-b64c-4270-9b2e-5bd8d1cc921e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.486570 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-80f78efd-b64c-4270-9b2e-5bd8d1cc921e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.487001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-80f78efd-b64c-4270-9b2e-5bd8d1cc921e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.655386 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-80f78efd-b64c-4270-9b2e-5bd8d1cc921e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:14.666908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-80f78efd-b64c-4270-9b2e-5bd8d1cc921e tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1727 microversion: 2.1 time: 0.193937 Aug 02 09:14:14.668097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 455/916] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:14 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:14.690538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f63c6eba-59b7-4968-abba-90da8f762957 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:14.693333 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f63c6eba-59b7-4968-abba-90da8f762957 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:14.702795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f63c6eba-59b7-4968-abba-90da8f762957 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.703616 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f63c6eba-59b7-4968-abba-90da8f762957 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.704410 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f63c6eba-59b7-4968-abba-90da8f762957 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.705131 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f63c6eba-59b7-4968-abba-90da8f762957 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.726220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:14:14.727156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:14:14.727637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:14:14.728144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:14:14.728515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:14:14.738451 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.743060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.743060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.743060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.747530 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:14.760074 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Getting quotas for project d65888d17d2e439592600a4e9305eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:14.766726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Getting quotas for user 02569c995a6d4b678933599f60ad3909 and project d65888d17d2e439592600a4e9305eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:14.798319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f63c6eba-59b7-4968-abba-90da8f762957 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107307 Aug 02 09:14:14.798319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 456/917] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 2 09:14:14 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:14.837700 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:14:14.840019 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4e329ec-9f5c-47ce-8524-06432371b7b7',volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:14:14.873620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6bf831ac-6f99-4204-8ef2-b16c8d38122d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:14.877704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6bf831ac-6f99-4204-8ef2-b16c8d38122d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:14.886295 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6bf831ac-6f99-4204-8ef2-b16c8d38122d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.886848 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6bf831ac-6f99-4204-8ef2-b16c8d38122d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.887732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6bf831ac-6f99-4204-8ef2-b16c8d38122d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.888549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6bf831ac-6f99-4204-8ef2-b16c8d38122d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.922212 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6bf831ac-6f99-4204-8ef2-b16c8d38122d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053261 Aug 02 09:14:14.941468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 457/918] 10.222.0.46 () {60 vars in 1343 bytes} [Tue Aug 2 09:14:14 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:15.027831 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-05a2d933-d1d3-4e10-9832-190348950652 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:15.033019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-05a2d933-d1d3-4e10-9832-190348950652 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:15.038982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-05a2d933-d1d3-4e10-9832-190348950652 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.039452 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-05a2d933-d1d3-4e10-9832-190348950652 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.040432 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-05a2d933-d1d3-4e10-9832-190348950652 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.040857 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-05a2d933-d1d3-4e10-9832-190348950652 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.068685 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-05a2d933-d1d3-4e10-9832-190348950652 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Going to try to terminate instance {{(pid=118368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:14:15.302594 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0fdca39e-827a-4c69-b067-21fcab2b17e8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.264423 Aug 02 09:14:15.309700 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 462/919] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:14:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:14:15.315176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5af98430-3ac7-474d-b703-559b4ce9e8f1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:15.316460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5af98430-3ac7-474d-b703-559b4ce9e8f1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:15.323932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5af98430-3ac7-474d-b703-559b4ce9e8f1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.324377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5af98430-3ac7-474d-b703-559b4ce9e8f1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.325358 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5af98430-3ac7-474d-b703-559b4ce9e8f1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.326003 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5af98430-3ac7-474d-b703-559b4ce9e8f1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.413447 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5af98430-3ac7-474d-b703-559b4ce9e8f1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.429636 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5af98430-3ac7-474d-b703-559b4ce9e8f1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1244 microversion: 2.1 time: 0.118530 Aug 02 09:14:15.434549 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 463/920] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:15 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1244 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:15.441722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-05a2d933-d1d3-4e10-9832-190348950652 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 204 len: 0 microversion: 2.20 time: 0.419828 Aug 02 09:14:15.442692 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 458/921] 10.222.0.46 () {60 vars in 1280 bytes} [Tue Aug 2 09:14:15 2022] DELETE /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 09:14:15.446190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3df7753e-a15f-4a52-aed0-2f552c2281f5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:15.446902 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3df7753e-a15f-4a52-aed0-2f552c2281f5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:15.451079 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:15.451999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:15.459967 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.461078 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.461725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.469349 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.529614 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3df7753e-a15f-4a52-aed0-2f552c2281f5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.544837 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3df7753e-a15f-4a52-aed0-2f552c2281f5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1094 microversion: 2.1 time: 0.104839 Aug 02 09:14:15.550444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 464/922] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:15 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:15.673215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.684353 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.685923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.687411 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bf6448e9-0e7a-463f-ae3d-0d4b7d02e2f6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.240367 Aug 02 09:14:15.688164 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 459/923] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:15 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:16.122895 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-4de55bda-52a1-46ec-8528-9479c88f114c req-c8012879-e574-4862-9dc2-19a0c1b24ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93fca05-bed7-45c7-93fb-47a31cdf58f6", "tag": "c69e6c6c-a629-4816-a638-07c69b3b85b0"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:16.136487 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-4de55bda-52a1-46ec-8528-9479c88f114c req-c8012879-e574-4862-9dc2-19a0c1b24ba2 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.137155 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-4de55bda-52a1-46ec-8528-9479c88f114c req-c8012879-e574-4862-9dc2-19a0c1b24ba2 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.148693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-4de55bda-52a1-46ec-8528-9479c88f114c req-c8012879-e574-4862-9dc2-19a0c1b24ba2 service nova] Creating event network-changed:c69e6c6c-a629-4816-a638-07c69b3b85b0 for instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 on hv-cinder-84713 Aug 02 09:14:16.160599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-4de55bda-52a1-46ec-8528-9479c88f114c req-c8012879-e574-4862-9dc2-19a0c1b24ba2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041657 Aug 02 09:14:16.161509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 465/924] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:16.454885 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-49134ffc-7088-4c84-996b-abcb98537abd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:16.455491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-49134ffc-7088-4c84-996b-abcb98537abd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:16.462358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49134ffc-7088-4c84-996b-abcb98537abd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.462806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49134ffc-7088-4c84-996b-abcb98537abd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.463743 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49134ffc-7088-4c84-996b-abcb98537abd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.464173 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49134ffc-7088-4c84-996b-abcb98537abd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.545374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-49134ffc-7088-4c84-996b-abcb98537abd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.552955 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-49134ffc-7088-4c84-996b-abcb98537abd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1244 microversion: 2.1 time: 0.102412 Aug 02 09:14:16.553522 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 460/925] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:16 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:16.571488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fa480287-fe3f-42b1-afdd-f172f67cd823 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:16.573324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fa480287-fe3f-42b1-afdd-f172f67cd823 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:16.580145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa480287-fe3f-42b1-afdd-f172f67cd823 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.580735 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa480287-fe3f-42b1-afdd-f172f67cd823 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.581558 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa480287-fe3f-42b1-afdd-f172f67cd823 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.582092 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fa480287-fe3f-42b1-afdd-f172f67cd823 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.646779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fa480287-fe3f-42b1-afdd-f172f67cd823 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.654947 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fa480287-fe3f-42b1-afdd-f172f67cd823 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1144 microversion: 2.1 time: 0.093486 Aug 02 09:14:16.655311 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 466/926] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:16 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:16.712438 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:16.713060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:16.723678 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.732253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.733116 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.738962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.760601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:16.978578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.996030 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.997712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.999006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c39cbb06-1001-4630-ba4f-ded2c5ff8176 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.291151 Aug 02 09:14:17.007796 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 461/927] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:16 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:17.575626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-febd6425-9df2-4417-8d46-a7954c6a8153 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:17.576470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-febd6425-9df2-4417-8d46-a7954c6a8153 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:17.584814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-febd6425-9df2-4417-8d46-a7954c6a8153 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.585974 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-febd6425-9df2-4417-8d46-a7954c6a8153 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.586954 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-febd6425-9df2-4417-8d46-a7954c6a8153 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.587454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-febd6425-9df2-4417-8d46-a7954c6a8153 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.657179 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-febd6425-9df2-4417-8d46-a7954c6a8153 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:17.665402 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-febd6425-9df2-4417-8d46-a7954c6a8153 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1292 microversion: 2.1 time: 0.093829 Aug 02 09:14:17.666003 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 467/928] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:17 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:17.676703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-dfb598ec-7892-43de-8285-98f6e78d5643 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:17.677302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-dfb598ec-7892-43de-8285-98f6e78d5643 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:17.685599 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dfb598ec-7892-43de-8285-98f6e78d5643 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.686030 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dfb598ec-7892-43de-8285-98f6e78d5643 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.686793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dfb598ec-7892-43de-8285-98f6e78d5643 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.687220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dfb598ec-7892-43de-8285-98f6e78d5643 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.752554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-dfb598ec-7892-43de-8285-98f6e78d5643 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:17.762128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-dfb598ec-7892-43de-8285-98f6e78d5643 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1192 microversion: 2.1 time: 0.089945 Aug 02 09:14:17.762888 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 462/929] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:17 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:18.022023 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:18.022918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:18.029467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.030117 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.030914 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.031432 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.191595 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-3007cc1e-3107-4f73-97b6-d556ce421b92 req-6c94308a-d506-4cd6-ba18-f8f9605d8160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93fca05-bed7-45c7-93fb-47a31cdf58f6", "tag": "c69e6c6c-a629-4816-a638-07c69b3b85b0"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:18.203029 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-3007cc1e-3107-4f73-97b6-d556ce421b92 req-6c94308a-d506-4cd6-ba18-f8f9605d8160 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.203373 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-3007cc1e-3107-4f73-97b6-d556ce421b92 req-6c94308a-d506-4cd6-ba18-f8f9605d8160 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.215484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-3007cc1e-3107-4f73-97b6-d556ce421b92 req-6c94308a-d506-4cd6-ba18-f8f9605d8160 service nova] Creating event network-changed:c69e6c6c-a629-4816-a638-07c69b3b85b0 for instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 on hv-cinder-84713 Aug 02 09:14:18.220989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-3007cc1e-3107-4f73-97b6-d556ce421b92 req-6c94308a-d506-4cd6-ba18-f8f9605d8160 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039665 Aug 02 09:14:18.221590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 463/930] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:18.265276 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.275361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.276922 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.278136 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fed52736-695d-4df6-a3be-93a45c10ada4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1721 microversion: 2.20 time: 0.260201 Aug 02 09:14:18.278800 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 468/931] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:18 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:18.691654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a093e41b-f22b-40ef-aa71-e81d2461ba67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:18.692518 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a093e41b-f22b-40ef-aa71-e81d2461ba67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:18.700899 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a093e41b-f22b-40ef-aa71-e81d2461ba67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.707133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a093e41b-f22b-40ef-aa71-e81d2461ba67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.707133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a093e41b-f22b-40ef-aa71-e81d2461ba67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.707133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a093e41b-f22b-40ef-aa71-e81d2461ba67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.787737 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ebe44dee-b1f4-43e1-b1b2-23e1c7c3d4b1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:18.789047 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ebe44dee-b1f4-43e1-b1b2-23e1c7c3d4b1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:18.797651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ebe44dee-b1f4-43e1-b1b2-23e1c7c3d4b1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.798558 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ebe44dee-b1f4-43e1-b1b2-23e1c7c3d4b1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.799568 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ebe44dee-b1f4-43e1-b1b2-23e1c7c3d4b1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.800174 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ebe44dee-b1f4-43e1-b1b2-23e1c7c3d4b1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.809964 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a093e41b-f22b-40ef-aa71-e81d2461ba67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.823463 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a093e41b-f22b-40ef-aa71-e81d2461ba67 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1310 microversion: 2.1 time: 0.136578 Aug 02 09:14:18.824317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 464/932] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:18 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1310 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:18.930731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ebe44dee-b1f4-43e1-b1b2-23e1c7c3d4b1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.959646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ebe44dee-b1f4-43e1-b1b2-23e1c7c3d4b1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1200 microversion: 2.1 time: 0.178653 Aug 02 09:14:18.969057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 469/933] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:18 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1200 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:19.304180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:19.305121 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:19.313271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.314283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.315301 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.315897 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.491476 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:19.529786 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:19.550397 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:19.552680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-47222d92-e784-452c-a6d0-47573870b66e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1654 microversion: 2.20 time: 0.254054 Aug 02 09:14:19.553776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 465/934] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:19 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1654 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:19.718788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-ae21e40f-9d85-4b43-9a7f-1a749d2a9c12 req-0a15b069-5b68-40ac-818a-d8c39ab5c69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c248147-71ed-4f5f-89cc-8ca12974efb4", "name": "network-vif-deleted", "tag": "27491509-00ef-451e-b2ac-f08e653e8310"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:19.745785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-ae21e40f-9d85-4b43-9a7f-1a749d2a9c12 req-0a15b069-5b68-40ac-818a-d8c39ab5c69d service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.749425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-ae21e40f-9d85-4b43-9a7f-1a749d2a9c12 req-0a15b069-5b68-40ac-818a-d8c39ab5c69d service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.781468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-ae21e40f-9d85-4b43-9a7f-1a749d2a9c12 req-0a15b069-5b68-40ac-818a-d8c39ab5c69d service nova] Creating event network-vif-deleted:27491509-00ef-451e-b2ac-f08e653e8310 for instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 on hv-cinder-84713 Aug 02 09:14:19.791968 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-ae21e40f-9d85-4b43-9a7f-1a749d2a9c12 req-0a15b069-5b68-40ac-818a-d8c39ab5c69d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078928 Aug 02 09:14:19.794210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 470/935] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:19.846911 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f8a04d72-f122-448f-9d1a-139fb41c669a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:19.848047 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f8a04d72-f122-448f-9d1a-139fb41c669a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:19.870051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f8a04d72-f122-448f-9d1a-139fb41c669a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.879034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f8a04d72-f122-448f-9d1a-139fb41c669a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.880155 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f8a04d72-f122-448f-9d1a-139fb41c669a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.883561 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f8a04d72-f122-448f-9d1a-139fb41c669a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.994751 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-54b7cc2a-0302-4bf5-b4a0-39f19269ef65 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:19.995787 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-54b7cc2a-0302-4bf5-b4a0-39f19269ef65 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:20.017074 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-54b7cc2a-0302-4bf5-b4a0-39f19269ef65 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.017805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-54b7cc2a-0302-4bf5-b4a0-39f19269ef65 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.019932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-54b7cc2a-0302-4bf5-b4a0-39f19269ef65 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.022100 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-54b7cc2a-0302-4bf5-b4a0-39f19269ef65 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.231040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f8a04d72-f122-448f-9d1a-139fb41c669a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.246532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f8a04d72-f122-448f-9d1a-139fb41c669a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1298 microversion: 2.1 time: 0.401641 Aug 02 09:14:20.250414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 466/936] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:19 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1298 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:20.384520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-54b7cc2a-0302-4bf5-b4a0-39f19269ef65 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.393241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-54b7cc2a-0302-4bf5-b4a0-39f19269ef65 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1278 microversion: 2.1 time: 0.404352 Aug 02 09:14:20.393829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 471/937] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:19 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1278 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:20.579254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:20.587934 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:20.595717 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.596242 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.597005 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.597699 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.634665 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.635369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.635981 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lazy-loading 'fault' on Instance uuid 6c248147-71ed-4f5f-89cc-8ca12974efb4 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:20.737166 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.755720 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.761200 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.762727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-de64551e-0bff-450b-8acd-954ab6e25531 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 200 len: 1371 microversion: 2.20 time: 0.187330 Aug 02 09:14:20.783228 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 467/938] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:20 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:21.118476 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-2c384ba7-358c-4f68-908b-d98818c49c6f req-729c323d-f0d0-422c-9161-1398f344862d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370371b8-72c0-4cc6-941c-6a5f6b6c1259", "tag": "c12d0248-16ec-43cf-ad14-77f5781cc7d2"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:21.147036 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-2c384ba7-358c-4f68-908b-d98818c49c6f req-729c323d-f0d0-422c-9161-1398f344862d service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.147879 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-2c384ba7-358c-4f68-908b-d98818c49c6f req-729c323d-f0d0-422c-9161-1398f344862d service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.162125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-2c384ba7-358c-4f68-908b-d98818c49c6f req-729c323d-f0d0-422c-9161-1398f344862d service nova] Creating event network-changed:c12d0248-16ec-43cf-ad14-77f5781cc7d2 for instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 on hv-cinder-84713 Aug 02 09:14:21.168850 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-2c384ba7-358c-4f68-908b-d98818c49c6f req-729c323d-f0d0-422c-9161-1398f344862d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057874 Aug 02 09:14:21.170663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 472/939] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:21.272991 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c7de2967-467b-44d8-8e21-02dbc8db1be1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.276692 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c7de2967-467b-44d8-8e21-02dbc8db1be1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.289977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c7de2967-467b-44d8-8e21-02dbc8db1be1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.290767 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c7de2967-467b-44d8-8e21-02dbc8db1be1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.292196 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c7de2967-467b-44d8-8e21-02dbc8db1be1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.292649 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c7de2967-467b-44d8-8e21-02dbc8db1be1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.416235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f47b2262-3f22-4569-ae27-e9fbbe778095 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.417431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f47b2262-3f22-4569-ae27-e9fbbe778095 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.432688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f47b2262-3f22-4569-ae27-e9fbbe778095 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.433383 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f47b2262-3f22-4569-ae27-e9fbbe778095 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.434499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f47b2262-3f22-4569-ae27-e9fbbe778095 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.434924 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f47b2262-3f22-4569-ae27-e9fbbe778095 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.697518 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f47b2262-3f22-4569-ae27-e9fbbe778095 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:21.707458 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f47b2262-3f22-4569-ae27-e9fbbe778095 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.295932 Aug 02 09:14:21.723661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 473/940] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:21 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:21.791032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.791628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.798736 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.799468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.800418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.801818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.831191 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] HTTP exception thrown: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Request method failure captured: Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 HTTP/1.1 Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkTPLpEUsgNbyBzzRepXJwyTzIpt23KGHIOF3TWNRBr6QVhTydsDtH3jN3ffxyHqv7m23_TnXP9A1IQb7ivKsmBdB2BgzmNj7TqY2iSa2sL9JUB8GiteHTW26Ezoqy1GLxmP9opmzRyc8ihSe2FPUbTezANdavwBDv2eMhwO3AyK14 Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:14:21.833213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 50918811a90a444eaf123b2aeb4a75b3 Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:14:21.834805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '6c248147-71ed-4f5f-89cc-8ca12974efb4'} Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:21.835723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:14:21.837223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:14:21.839660 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Returning 404 to user: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:21.844822 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c7de2967-467b-44d8-8e21-02dbc8db1be1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:21.854377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2ae02af5-0089-43b8-aa50-26436326d6b6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 404 len: 111 microversion: 2.20 time: 0.063560 Aug 02 09:14:21.856083 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 474/941] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:21 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:14:21.856859 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c7de2967-467b-44d8-8e21-02dbc8db1be1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.589299 Aug 02 09:14:21.857705 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 468/942] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:21 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:21.865815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5cb5b102-cbc0-470b-b932-f0969eb9a794 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '.version_select at 0x7f0f2d4d23a0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.942999 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5cb5b102-cbc0-470b-b932-f0969eb9a794 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034427762" status: 204 len: 0 microversion: 2.20 time: 0.081389 Aug 02 09:14:21.947941 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 475/943] 10.222.0.46 () {60 vars in 1262 bytes} [Tue Aug 2 09:14:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034427762 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 09:14:22.737250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-79774a2a-ef44-473d-8290-0d64977ef42a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:22.739008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-79774a2a-ef44-473d-8290-0d64977ef42a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:22.746707 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79774a2a-ef44-473d-8290-0d64977ef42a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.747562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79774a2a-ef44-473d-8290-0d64977ef42a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.748598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79774a2a-ef44-473d-8290-0d64977ef42a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.749262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79774a2a-ef44-473d-8290-0d64977ef42a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.884996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-206ae0a3-f06e-46bf-84ba-8b076f2e0c8f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:22.885831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-206ae0a3-f06e-46bf-84ba-8b076f2e0c8f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:22.895574 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-206ae0a3-f06e-46bf-84ba-8b076f2e0c8f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.896749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-206ae0a3-f06e-46bf-84ba-8b076f2e0c8f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.898741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-206ae0a3-f06e-46bf-84ba-8b076f2e0c8f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.902451 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-206ae0a3-f06e-46bf-84ba-8b076f2e0c8f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.172492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-206ae0a3-f06e-46bf-84ba-8b076f2e0c8f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:23.174366 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-79774a2a-ef44-473d-8290-0d64977ef42a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:23.187945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-79774a2a-ef44-473d-8290-0d64977ef42a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.459350 Aug 02 09:14:23.188198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-206ae0a3-f06e-46bf-84ba-8b076f2e0c8f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.310971 Aug 02 09:14:23.189584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 476/944] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:22 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:23.191268 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 469/945] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:22 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:23.214585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1f5c7fe9-e47d-459c-9254-e37ed027e84e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'create', calling method: .version_select at 0x7f0f2d4d0ca0>, body: {"keypair": {"name": "tempest-keypair-2097893628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH7xyAe5UDPZIdg3K0M5cjzXyZ00OXaDyLkFnGUG+/i8Pf7tPcuBPfhaPg6G2tkeW+DusloI4jCdTiYfEnKN51L6agCtVH1zDpyIJ562f5STtK0M34woHsRL0yvYxNe2A=="}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:23.235488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-1f5c7fe9-e47d-459c-9254-e37ed027e84e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Getting quotas for project 7e47ffad695c4b049ca730c8cc43b9f9. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:23.240842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-1f5c7fe9-e47d-459c-9254-e37ed027e84e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Getting quotas for user 50918811a90a444eaf123b2aeb4a75b3 and project 7e47ffad695c4b049ca730c8cc43b9f9. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:23.343632 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1f5c7fe9-e47d-459c-9254-e37ed027e84e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.132997 Aug 02 09:14:23.344556 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 477/946] 10.222.0.46 () {62 vars in 1200 bytes} [Tue Aug 2 09:14:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 09:14:23.897993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-6a713667-fed6-4645-9b0d-9fc7c420741e req-7149dc6e-3b15-474e-9e4b-4c3e0b8b14e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f440de7e-1c06-4efd-aa35-34b3ab64b494", "tag": "826babce-e872-4dc2-b4f6-87a692125e7b"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:23.914653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-6a713667-fed6-4645-9b0d-9fc7c420741e req-7149dc6e-3b15-474e-9e4b-4c3e0b8b14e3 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.915501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-6a713667-fed6-4645-9b0d-9fc7c420741e req-7149dc6e-3b15-474e-9e4b-4c3e0b8b14e3 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.932388 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-6a713667-fed6-4645-9b0d-9fc7c420741e req-7149dc6e-3b15-474e-9e4b-4c3e0b8b14e3 service nova] Creating event network-changed:826babce-e872-4dc2-b4f6-87a692125e7b for instance f440de7e-1c06-4efd-aa35-34b3ab64b494 on hv-cinder-84713 Aug 02 09:14:23.947470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-6a713667-fed6-4645-9b0d-9fc7c420741e req-7149dc6e-3b15-474e-9e4b-4c3e0b8b14e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053812 Aug 02 09:14:23.948661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 470/947] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:24.226264 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:24.235651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ab226e94-e9d2-4b83-879b-e487a2b64579 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:24.238058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ab226e94-e9d2-4b83-879b-e487a2b64579 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:24.242182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-242f9523-e52e-4b3a-9e3b-27a86f96a9d6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:24.243232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-242f9523-e52e-4b3a-9e3b-27a86f96a9d6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:24.256122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ab226e94-e9d2-4b83-879b-e487a2b64579 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.263919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ab226e94-e9d2-4b83-879b-e487a2b64579 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.266442 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-242f9523-e52e-4b3a-9e3b-27a86f96a9d6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.266873 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ab226e94-e9d2-4b83-879b-e487a2b64579 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.267919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ab226e94-e9d2-4b83-879b-e487a2b64579 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.269500 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-242f9523-e52e-4b3a-9e3b-27a86f96a9d6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.270578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-242f9523-e52e-4b3a-9e3b-27a86f96a9d6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.273835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-242f9523-e52e-4b3a-9e3b-27a86f96a9d6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.275470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=12 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:24.506034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-242f9523-e52e-4b3a-9e3b-27a86f96a9d6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.515067 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-242f9523-e52e-4b3a-9e3b-27a86f96a9d6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.290174 Aug 02 09:14:24.530170 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 471/948] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:24 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:24.534572 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ab226e94-e9d2-4b83-879b-e487a2b64579 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.544836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ab226e94-e9d2-4b83-879b-e487a2b64579 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.322938 Aug 02 09:14:24.574734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 478/949] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:24 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:25.538297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cb68dd8c-c99b-4d2e-9e62-fdff628ecf69 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:25.539653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cb68dd8c-c99b-4d2e-9e62-fdff628ecf69 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:25.547337 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb68dd8c-c99b-4d2e-9e62-fdff628ecf69 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.547966 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb68dd8c-c99b-4d2e-9e62-fdff628ecf69 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.548868 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb68dd8c-c99b-4d2e-9e62-fdff628ecf69 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.549542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cb68dd8c-c99b-4d2e-9e62-fdff628ecf69 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.582755 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cb34964c-d7e6-4c7b-a118-2763a83d9d8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:25.587680 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cb34964c-d7e6-4c7b-a118-2763a83d9d8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:25.596979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:25.607742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cb34964c-d7e6-4c7b-a118-2763a83d9d8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.613965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cb34964c-d7e6-4c7b-a118-2763a83d9d8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.613965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cb34964c-d7e6-4c7b-a118-2763a83d9d8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.613965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cb34964c-d7e6-4c7b-a118-2763a83d9d8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.804441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-cb34964c-d7e6-4c7b-a118-2763a83d9d8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:25.813986 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cb34964c-d7e6-4c7b-a118-2763a83d9d8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.247874 Aug 02 09:14:25.821058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 479/950] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:25 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:25.826117 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cb68dd8c-c99b-4d2e-9e62-fdff628ecf69 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:25.834597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cb68dd8c-c99b-4d2e-9e62-fdff628ecf69 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.301270 Aug 02 09:14:25.836236 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 472/951] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:25 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:26.731079 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-690988799", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ea4ad1-853e-4fff-8e6d-c1cd8407e938"}], "security_groups": [{"name": "tempest-securitygroup--149781069"}], "key_name": "tempest-keypair-2097893628", "user_data": "}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:26.840394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c730682a-b6b9-444b-9eeb-4d42d605780a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:26.840918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] validate_networks() for [('21ea4ad1-853e-4fff-8e6d-c1cd8407e938', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:14:26.841033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c730682a-b6b9-444b-9eeb-4d42d605780a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:26.847845 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c730682a-b6b9-444b-9eeb-4d42d605780a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.848296 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c730682a-b6b9-444b-9eeb-4d42d605780a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.849069 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c730682a-b6b9-444b-9eeb-4d42d605780a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.849508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c730682a-b6b9-444b-9eeb-4d42d605780a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.041790 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c730682a-b6b9-444b-9eeb-4d42d605780a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:27.050719 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c730682a-b6b9-444b-9eeb-4d42d605780a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.214492 Aug 02 09:14:27.056506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 473/952] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:26 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:27.079551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-034897e2-f04d-41d8-8778-f91d77713cd2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:27.080169 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-034897e2-f04d-41d8-8778-f91d77713cd2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:27.087262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-034897e2-f04d-41d8-8778-f91d77713cd2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.087560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-034897e2-f04d-41d8-8778-f91d77713cd2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.088919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-034897e2-f04d-41d8-8778-f91d77713cd2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.089488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-034897e2-f04d-41d8-8778-f91d77713cd2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.289094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-034897e2-f04d-41d8-8778-f91d77713cd2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:27.298412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-034897e2-f04d-41d8-8778-f91d77713cd2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.224718 Aug 02 09:14:27.299119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 474/953] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:27 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:27.335872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:14:27.336326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:14:27.336804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:14:27.337214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:14:27.337628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:14:27.354177 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.354638 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.359612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.359612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.384931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Getting quotas for project 7e47ffad695c4b049ca730c8cc43b9f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:27.389633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Getting quotas for user 50918811a90a444eaf123b2aeb4a75b3 and project 7e47ffad695c4b049ca730c8cc43b9f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:27.405552 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:14:27.411641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:14:27.567434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c129c1a5-19e6-401f-9bb5-d18f445b4ed5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.843294 Aug 02 09:14:27.568466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 480/954] 10.222.0.46 () {62 vars in 1188 bytes} [Tue Aug 2 09:14:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 09:14:27.582426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8c7e5669-415c-433d-8dde-43bce414d53d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:27.583689 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8c7e5669-415c-433d-8dde-43bce414d53d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:27.672927 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8c7e5669-415c-433d-8dde-43bce414d53d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:27.684576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8c7e5669-415c-433d-8dde-43bce414d53d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:27.692136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8c7e5669-415c-433d-8dde-43bce414d53d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:27.692136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8c7e5669-415c-433d-8dde-43bce414d53d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1281 microversion: 2.20 time: 0.111583 Aug 02 09:14:27.694796 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 475/955] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:27 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1281 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:28.076697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-68e3af9d-189b-46f2-aeeb-68954cb331c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:28.077385 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-68e3af9d-189b-46f2-aeeb-68954cb331c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:28.084282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-68e3af9d-189b-46f2-aeeb-68954cb331c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.085450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-68e3af9d-189b-46f2-aeeb-68954cb331c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.086248 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-68e3af9d-189b-46f2-aeeb-68954cb331c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.086739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-68e3af9d-189b-46f2-aeeb-68954cb331c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.247395 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-68e3af9d-189b-46f2-aeeb-68954cb331c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.255626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-68e3af9d-189b-46f2-aeeb-68954cb331c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.183718 Aug 02 09:14:28.256218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 481/956] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:28 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:28.319590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-35f6afc0-72ad-4fad-a9e9-0c5b180ec189 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:28.320357 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-35f6afc0-72ad-4fad-a9e9-0c5b180ec189 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:28.328305 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-35f6afc0-72ad-4fad-a9e9-0c5b180ec189 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.329021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-35f6afc0-72ad-4fad-a9e9-0c5b180ec189 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.330001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-35f6afc0-72ad-4fad-a9e9-0c5b180ec189 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.330585 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-35f6afc0-72ad-4fad-a9e9-0c5b180ec189 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.530393 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-35f6afc0-72ad-4fad-a9e9-0c5b180ec189 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.559723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-35f6afc0-72ad-4fad-a9e9-0c5b180ec189 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.240334 Aug 02 09:14:28.562174 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 476/957] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:28 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:28.713623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:28.714238 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:28.720316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.720845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.721567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.722032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.788797 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.797756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.799308 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.800466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6639e1ac-9487-47b7-8765-b4a65d157dfb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1285 microversion: 2.20 time: 0.091462 Aug 02 09:14:28.801026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 482/958] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:28 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:29.278598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a3bd8101-0d3b-4596-8e6c-8a69004b9ac7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:29.280322 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a3bd8101-0d3b-4596-8e6c-8a69004b9ac7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:29.292122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a3bd8101-0d3b-4596-8e6c-8a69004b9ac7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.292854 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a3bd8101-0d3b-4596-8e6c-8a69004b9ac7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.293808 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a3bd8101-0d3b-4596-8e6c-8a69004b9ac7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.294704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a3bd8101-0d3b-4596-8e6c-8a69004b9ac7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.504091 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a3bd8101-0d3b-4596-8e6c-8a69004b9ac7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.515086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a3bd8101-0d3b-4596-8e6c-8a69004b9ac7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.243114 Aug 02 09:14:29.519116 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 477/959] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:29 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:29.583570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2d87dc8e-abe3-4a40-93fa-d55aee25fd21 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:29.587406 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2d87dc8e-abe3-4a40-93fa-d55aee25fd21 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:29.592753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d87dc8e-abe3-4a40-93fa-d55aee25fd21 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.594143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d87dc8e-abe3-4a40-93fa-d55aee25fd21 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.595122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d87dc8e-abe3-4a40-93fa-d55aee25fd21 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.595733 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2d87dc8e-abe3-4a40-93fa-d55aee25fd21 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.804301 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2d87dc8e-abe3-4a40-93fa-d55aee25fd21 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.814969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2d87dc8e-abe3-4a40-93fa-d55aee25fd21 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.235172 Aug 02 09:14:29.815569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 483/960] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:29 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:29.833754 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:29.834925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:29.841862 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.847392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.847392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.847392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.955084 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.964702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.966275 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.967643 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9222c252-22db-4b1d-87e8-469fd5eba3fc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1277 microversion: 2.20 time: 0.138130 Aug 02 09:14:29.968576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 478/961] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:29 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:30.536139 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ff8b1ce9-6aa1-462c-9b32-17f51977ded0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.536845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ff8b1ce9-6aa1-462c-9b32-17f51977ded0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.548652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ff8b1ce9-6aa1-462c-9b32-17f51977ded0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.549757 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ff8b1ce9-6aa1-462c-9b32-17f51977ded0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.551389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ff8b1ce9-6aa1-462c-9b32-17f51977ded0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.552175 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ff8b1ce9-6aa1-462c-9b32-17f51977ded0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.739362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ff8b1ce9-6aa1-462c-9b32-17f51977ded0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:30.749044 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ff8b1ce9-6aa1-462c-9b32-17f51977ded0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.216509 Aug 02 09:14:30.750339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 484/962] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:30.836696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-14c97c8d-e0f7-4c7d-b6ef-e28abf1f6515 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.837321 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-14c97c8d-e0f7-4c7d-b6ef-e28abf1f6515 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.845818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14c97c8d-e0f7-4c7d-b6ef-e28abf1f6515 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.846735 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14c97c8d-e0f7-4c7d-b6ef-e28abf1f6515 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.847885 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14c97c8d-e0f7-4c7d-b6ef-e28abf1f6515 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.848568 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14c97c8d-e0f7-4c7d-b6ef-e28abf1f6515 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.996259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.996259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:31.003899 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.004352 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.005147 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.005582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.107540 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.111570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:31.127981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.129727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.132285 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-454736d5-3ccc-4759-87f6-eee73f403802 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1351 microversion: 2.20 time: 0.144410 Aug 02 09:14:31.133491 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 485/963] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:31.297708 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-14c97c8d-e0f7-4c7d-b6ef-e28abf1f6515 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.317215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-14c97c8d-e0f7-4c7d-b6ef-e28abf1f6515 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.484776 Aug 02 09:14:31.317540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 479/964] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:31.776901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e2d29ec3-cd66-4215-8e9c-a00edbcefb9a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:31.776901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e2d29ec3-cd66-4215-8e9c-a00edbcefb9a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:31.802361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e2d29ec3-cd66-4215-8e9c-a00edbcefb9a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.803183 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e2d29ec3-cd66-4215-8e9c-a00edbcefb9a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.805441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e2d29ec3-cd66-4215-8e9c-a00edbcefb9a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.806542 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e2d29ec3-cd66-4215-8e9c-a00edbcefb9a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.972768 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e2d29ec3-cd66-4215-8e9c-a00edbcefb9a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.983262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e2d29ec3-cd66-4215-8e9c-a00edbcefb9a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.214422 Aug 02 09:14:31.983724 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 486/965] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:31 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:32.159574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:32.160389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:32.169913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.171055 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.172061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.172737 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.177946 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:32.339413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-88a9d8e7-4fab-4290-bd18-b18d569d769f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:32.340135 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-88a9d8e7-4fab-4290-bd18-b18d569d769f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:32.352654 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88a9d8e7-4fab-4290-bd18-b18d569d769f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.354506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88a9d8e7-4fab-4290-bd18-b18d569d769f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.354506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88a9d8e7-4fab-4290-bd18-b18d569d769f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.354506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88a9d8e7-4fab-4290-bd18-b18d569d769f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.533265 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:32.548349 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:32.556630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:32.556630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9618bda1-3915-4319-8958-1f87670f9154 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.401987 Aug 02 09:14:32.557814 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 480/966] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:32 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:32.562557 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-eee79ca6-d6c1-4949-88a8-0721bcd24cdd req-a736b2c3-d63f-4249-a13e-14044cd85f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f440de7e-1c06-4efd-aa35-34b3ab64b494", "name": "network-vif-plugged", "status": "completed", "tag": "826babce-e872-4dc2-b4f6-87a692125e7b"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:32.575439 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-eee79ca6-d6c1-4949-88a8-0721bcd24cdd req-a736b2c3-d63f-4249-a13e-14044cd85f7f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.576169 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-eee79ca6-d6c1-4949-88a8-0721bcd24cdd req-a736b2c3-d63f-4249-a13e-14044cd85f7f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.589659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-eee79ca6-d6c1-4949-88a8-0721bcd24cdd req-a736b2c3-d63f-4249-a13e-14044cd85f7f service nova] Creating event network-vif-plugged:826babce-e872-4dc2-b4f6-87a692125e7b for instance f440de7e-1c06-4efd-aa35-34b3ab64b494 on hv-cinder-84713 Aug 02 09:14:32.601358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-eee79ca6-d6c1-4949-88a8-0721bcd24cdd req-a736b2c3-d63f-4249-a13e-14044cd85f7f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041014 Aug 02 09:14:32.602005 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 481/967] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:32.770388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-88a9d8e7-4fab-4290-bd18-b18d569d769f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:32.778813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-88a9d8e7-4fab-4290-bd18-b18d569d769f tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.443852 Aug 02 09:14:32.793912 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 487/968] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:32 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:33.006675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-58631f50-571b-4e46-8a69-80c5829ceb91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:33.010618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-58631f50-571b-4e46-8a69-80c5829ceb91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:33.020180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-58631f50-571b-4e46-8a69-80c5829ceb91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.025525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-58631f50-571b-4e46-8a69-80c5829ceb91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.026728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-58631f50-571b-4e46-8a69-80c5829ceb91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.027335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-58631f50-571b-4e46-8a69-80c5829ceb91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.323959 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-58631f50-571b-4e46-8a69-80c5829ceb91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.333329 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-58631f50-571b-4e46-8a69-80c5829ceb91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.332293 Aug 02 09:14:33.343858 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 482/969] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:32 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:33.582857 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:33.583488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:33.594823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.595361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.596201 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.596642 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.801288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-333e5920-49fd-440f-afef-4114acaf1584 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:33.801905 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-333e5920-49fd-440f-afef-4114acaf1584 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:33.817140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-333e5920-49fd-440f-afef-4114acaf1584 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.817555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-333e5920-49fd-440f-afef-4114acaf1584 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.819255 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-333e5920-49fd-440f-afef-4114acaf1584 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.819767 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-333e5920-49fd-440f-afef-4114acaf1584 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.866388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.879188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.881574 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.882752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ff7ec804-002c-41f2-b3fd-d70a84722fa4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.304472 Aug 02 09:14:33.884154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 488/970] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:33 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:33.925752 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-cf6204c5-6a88-4c44-8be3-99620da956d6 req-966cf7b0-e2f7-4570-b449-5167ab0ff3fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea1ac8c-8116-4fed-a2e3-230762ade4b1", "tag": "7d6ddb74-8337-4c6b-9b6b-fd59368697e0"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:33.951231 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-cf6204c5-6a88-4c44-8be3-99620da956d6 req-966cf7b0-e2f7-4570-b449-5167ab0ff3fd service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.952294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-cf6204c5-6a88-4c44-8be3-99620da956d6 req-966cf7b0-e2f7-4570-b449-5167ab0ff3fd service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.965468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-cf6204c5-6a88-4c44-8be3-99620da956d6 req-966cf7b0-e2f7-4570-b449-5167ab0ff3fd service nova] Creating event network-changed:7d6ddb74-8337-4c6b-9b6b-fd59368697e0 for instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 on hv-cinder-84713 Aug 02 09:14:33.970900 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-cf6204c5-6a88-4c44-8be3-99620da956d6 req-966cf7b0-e2f7-4570-b449-5167ab0ff3fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048613 Aug 02 09:14:33.971774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 489/971] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:34.045475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-333e5920-49fd-440f-afef-4114acaf1584 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:34.053768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-333e5920-49fd-440f-afef-4114acaf1584 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.256782 Aug 02 09:14:34.057947 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 483/972] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:33 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:34.367821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-56425cd1-334d-45dd-aadd-f5b42fca535d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.368725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-56425cd1-334d-45dd-aadd-f5b42fca535d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.380391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:34.396053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56425cd1-334d-45dd-aadd-f5b42fca535d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.396707 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56425cd1-334d-45dd-aadd-f5b42fca535d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.399456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56425cd1-334d-45dd-aadd-f5b42fca535d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.400067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-56425cd1-334d-45dd-aadd-f5b42fca535d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.707921 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-56425cd1-334d-45dd-aadd-f5b42fca535d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:34.716242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-56425cd1-334d-45dd-aadd-f5b42fca535d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.354558 Aug 02 09:14:34.717516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 490/973] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:34.747848 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-06602feb-99d0-4a91-9f4f-b23247e4c10d req-bcfb5acc-2a91-4a48-bbdd-fc73ecd7093e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370371b8-72c0-4cc6-941c-6a5f6b6c1259", "name": "network-vif-plugged", "status": "completed", "tag": "c12d0248-16ec-43cf-ad14-77f5781cc7d2"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:34.761023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-06602feb-99d0-4a91-9f4f-b23247e4c10d req-bcfb5acc-2a91-4a48-bbdd-fc73ecd7093e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.761769 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-06602feb-99d0-4a91-9f4f-b23247e4c10d req-bcfb5acc-2a91-4a48-bbdd-fc73ecd7093e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.774952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-06602feb-99d0-4a91-9f4f-b23247e4c10d req-bcfb5acc-2a91-4a48-bbdd-fc73ecd7093e service nova] Creating event network-vif-plugged:c12d0248-16ec-43cf-ad14-77f5781cc7d2 for instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 on hv-cinder-84713 Aug 02 09:14:34.780188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-06602feb-99d0-4a91-9f4f-b23247e4c10d req-bcfb5acc-2a91-4a48-bbdd-fc73ecd7093e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043909 Aug 02 09:14:34.780945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 484/974] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:34.907626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.908374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.915033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.915479 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.916238 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.916855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.071210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.081043 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.085675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.085675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1c30f879-8d18-4cee-ad3b-0285b36f836e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.180204 Aug 02 09:14:35.085675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 491/975] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:35.089841 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7b6fec7b-1d0b-4311-82b9-b740569db8c4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.090531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7b6fec7b-1d0b-4311-82b9-b740569db8c4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.098224 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7b6fec7b-1d0b-4311-82b9-b740569db8c4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.099007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7b6fec7b-1d0b-4311-82b9-b740569db8c4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.100704 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7b6fec7b-1d0b-4311-82b9-b740569db8c4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.101209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7b6fec7b-1d0b-4311-82b9-b740569db8c4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.253729 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-08e03a0d-ef38-4b9e-962d-fb11b8cbf3f7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Action: 'create', calling method: .version_select at 0x7f0f2d5b7ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-686869677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkJO18+sPPlsMTM8wPmbND7DarUcijnRpfkyuZNoxpkfLhUWfn9RGpV2jzYHKcCXFCizuT83Fdtz3XgTrc31XgkL1WK+mqtC6zFUoMkIe2NaSO7OcSU6rfMEAuf5vAERg=="}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:35.259931 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7b6fec7b-1d0b-4311-82b9-b740569db8c4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.262814 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:35.268934 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7b6fec7b-1d0b-4311-82b9-b740569db8c4 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1365 microversion: 2.1 time: 0.182647 Aug 02 09:14:35.283407 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 492/976] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:35 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:35.283637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-08e03a0d-ef38-4b9e-962d-fb11b8cbf3f7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Getting quotas for project 142acfd7d2a7483083b9807280598eef. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:35.283637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-08e03a0d-ef38-4b9e-962d-fb11b8cbf3f7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Getting quotas for user a1300b00c7214d168e72850a8585bd47 and project 142acfd7d2a7483083b9807280598eef. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:35.388969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-08e03a0d-ef38-4b9e-962d-fb11b8cbf3f7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.395150 Aug 02 09:14:35.388969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 485/977] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:14:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:35.737679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cc9ab5e9-ad01-4097-bd54-dc2bf90d4db0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.738325 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cc9ab5e9-ad01-4097-bd54-dc2bf90d4db0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.745695 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cc9ab5e9-ad01-4097-bd54-dc2bf90d4db0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.746184 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cc9ab5e9-ad01-4097-bd54-dc2bf90d4db0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.746981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cc9ab5e9-ad01-4097-bd54-dc2bf90d4db0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.747629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cc9ab5e9-ad01-4097-bd54-dc2bf90d4db0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.914775 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-cc9ab5e9-ad01-4097-bd54-dc2bf90d4db0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.942061 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cc9ab5e9-ad01-4097-bd54-dc2bf90d4db0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.194080 Aug 02 09:14:35.942061 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 493/978] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:35 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:36.108303 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.109025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.118052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.118500 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.119292 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.119723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.267301 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.276339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.279471 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.279471 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ce8394f9-0e97-4a89-b468-0ff059d43b5c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.175017 Aug 02 09:14:36.279853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 486/979] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:36.291067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b911f605-b323-4bb1-9ca3-080475cfde89 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.291814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b911f605-b323-4bb1-9ca3-080475cfde89 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.298472 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b911f605-b323-4bb1-9ca3-080475cfde89 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.299045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b911f605-b323-4bb1-9ca3-080475cfde89 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.299909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b911f605-b323-4bb1-9ca3-080475cfde89 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.300491 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b911f605-b323-4bb1-9ca3-080475cfde89 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.458201 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b911f605-b323-4bb1-9ca3-080475cfde89 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.469272 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b911f605-b323-4bb1-9ca3-080475cfde89 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1554 microversion: 2.1 time: 0.182423 Aug 02 09:14:36.470597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 494/980] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:36.490963 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-52241c51-aa99-4978-8fd4-b8274cc24239 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.491600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-52241c51-aa99-4978-8fd4-b8274cc24239 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.500883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-52241c51-aa99-4978-8fd4-b8274cc24239 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.500883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-52241c51-aa99-4978-8fd4-b8274cc24239 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.500883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-52241c51-aa99-4978-8fd4-b8274cc24239 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.500883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-52241c51-aa99-4978-8fd4-b8274cc24239 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.590135 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-52241c51-aa99-4978-8fd4-b8274cc24239 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103229 Aug 02 09:14:36.590775 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 487/981] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:36.955729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1f1a3aa4-73e0-4924-89e3-81ab8fc528c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.955729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1f1a3aa4-73e0-4924-89e3-81ab8fc528c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.960109 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f1a3aa4-73e0-4924-89e3-81ab8fc528c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.961014 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f1a3aa4-73e0-4924-89e3-81ab8fc528c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.962348 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f1a3aa4-73e0-4924-89e3-81ab8fc528c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.962883 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1f1a3aa4-73e0-4924-89e3-81ab8fc528c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.306968 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:37.307567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:37.315183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.315866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.316881 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.317465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.333697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1f1a3aa4-73e0-4924-89e3-81ab8fc528c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.348119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1f1a3aa4-73e0-4924-89e3-81ab8fc528c1 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.402099 Aug 02 09:14:37.350701 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 495/982] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:37.477511 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.485663 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.487201 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.488297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f5cd632f-0be0-4718-8057-f1384abc0551 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.188535 Aug 02 09:14:37.488871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 488/983] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:37 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:38.136580 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-d0a79cc9-a895-4830-b5ac-4b1e28619509 req-a28e41b1-4b4d-491e-b8a8-77c8334d1346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f440de7e-1c06-4efd-aa35-34b3ab64b494", "tag": "826babce-e872-4dc2-b4f6-87a692125e7b"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:38.145502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:38.147955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=18 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:38.158158 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d0a79cc9-a895-4830-b5ac-4b1e28619509 req-a28e41b1-4b4d-491e-b8a8-77c8334d1346 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.160369 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d0a79cc9-a895-4830-b5ac-4b1e28619509 req-a28e41b1-4b4d-491e-b8a8-77c8334d1346 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.174066 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-d0a79cc9-a895-4830-b5ac-4b1e28619509 req-a28e41b1-4b4d-491e-b8a8-77c8334d1346 service nova] Creating event network-changed:826babce-e872-4dc2-b4f6-87a692125e7b for instance f440de7e-1c06-4efd-aa35-34b3ab64b494 on hv-cinder-84713 Aug 02 09:14:38.179227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-d0a79cc9-a895-4830-b5ac-4b1e28619509 req-a28e41b1-4b4d-491e-b8a8-77c8334d1346 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046531 Aug 02 09:14:38.179825 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 496/984] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:38.372036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f4d90e97-0007-4731-bc5b-05dd985b49e7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:38.372036 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f4d90e97-0007-4731-bc5b-05dd985b49e7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:38.378158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f4d90e97-0007-4731-bc5b-05dd985b49e7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.378609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f4d90e97-0007-4731-bc5b-05dd985b49e7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.379395 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f4d90e97-0007-4731-bc5b-05dd985b49e7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.380475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f4d90e97-0007-4731-bc5b-05dd985b49e7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.514149 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:38.514891 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:38.525674 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.526157 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.526947 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.527379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.576927 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f4d90e97-0007-4731-bc5b-05dd985b49e7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.588028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f4d90e97-0007-4731-bc5b-05dd985b49e7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.221893 Aug 02 09:14:38.589192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 489/985] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:38 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:38.741171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.753271 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.754836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.756554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-55c5bbce-b375-40bf-962b-b3f161a72982 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.246823 Aug 02 09:14:38.757489 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 497/986] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:38 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:39.608654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2f397e97-43aa-47ca-8dd3-51e873a28555 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:39.609462 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2f397e97-43aa-47ca-8dd3-51e873a28555 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:39.616198 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2f397e97-43aa-47ca-8dd3-51e873a28555 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.616653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2f397e97-43aa-47ca-8dd3-51e873a28555 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.617467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2f397e97-43aa-47ca-8dd3-51e873a28555 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.617929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2f397e97-43aa-47ca-8dd3-51e873a28555 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.757852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2f397e97-43aa-47ca-8dd3-51e873a28555 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.766099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2f397e97-43aa-47ca-8dd3-51e873a28555 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1266 microversion: 2.1 time: 0.161275 Aug 02 09:14:39.766674 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 490/987] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:39 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:39.779281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:39.780536 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:39.787278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.787742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.788519 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.788960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.962368 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.971472 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.974173 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.975401 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3b537834-fa14-4fde-980c-310ef4f23b09 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.200199 Aug 02 09:14:39.976137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 498/988] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:39 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:40.788229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-781bd9d9-3d80-4809-804d-e70d80e956d2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:40.788825 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-781bd9d9-3d80-4809-804d-e70d80e956d2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:40.795906 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-781bd9d9-3d80-4809-804d-e70d80e956d2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.796645 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-781bd9d9-3d80-4809-804d-e70d80e956d2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.797609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-781bd9d9-3d80-4809-804d-e70d80e956d2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.798288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-781bd9d9-3d80-4809-804d-e70d80e956d2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.961170 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-781bd9d9-3d80-4809-804d-e70d80e956d2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:40.971979 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-781bd9d9-3d80-4809-804d-e70d80e956d2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1453 microversion: 2.1 time: 0.188028 Aug 02 09:14:40.981971 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 491/989] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:40 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:40.995214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-44f58051-ef36-4823-baa1-ada6d0173538 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:40.996486 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-44f58051-ef36-4823-baa1-ada6d0173538 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:41.003422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:41.004025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:41.007399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44f58051-ef36-4823-baa1-ada6d0173538 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.009629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44f58051-ef36-4823-baa1-ada6d0173538 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.009629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44f58051-ef36-4823-baa1-ada6d0173538 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.009629 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44f58051-ef36-4823-baa1-ada6d0173538 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.011533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.011984 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.012758 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.013191 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.173828 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.181727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-44f58051-ef36-4823-baa1-ada6d0173538 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.188369 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.190452 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.191780 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-11923b25-0043-499c-a11c-35874680b6fb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.192686 Aug 02 09:14:41.192565 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 492/990] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:40 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:41.206645 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-44f58051-ef36-4823-baa1-ada6d0173538 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1453 microversion: 2.1 time: 0.216053 Aug 02 09:14:41.207235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 499/991] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:40 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:42.214184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:42.214790 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:42.221205 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.221654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.222503 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.222889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.365831 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.374704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.376430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.377559 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cabb0b07-4d9e-4111-a184-8301fb1c67f5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.167266 Aug 02 09:14:42.378169 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 493/992] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:42 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:42.619059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-bdcdb72c-cc1c-432f-ae26-d98f604dc918 req-0e347eb8-d135-4303-b8a6-577fa772e4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea1ac8c-8116-4fed-a2e3-230762ade4b1", "name": "network-vif-plugged", "status": "completed", "tag": "7d6ddb74-8337-4c6b-9b6b-fd59368697e0"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:42.631158 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-bdcdb72c-cc1c-432f-ae26-d98f604dc918 req-0e347eb8-d135-4303-b8a6-577fa772e4fa service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.631628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-bdcdb72c-cc1c-432f-ae26-d98f604dc918 req-0e347eb8-d135-4303-b8a6-577fa772e4fa service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.643457 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-bdcdb72c-cc1c-432f-ae26-d98f604dc918 req-0e347eb8-d135-4303-b8a6-577fa772e4fa service nova] Creating event network-vif-plugged:7d6ddb74-8337-4c6b-9b6b-fd59368697e0 for instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 on hv-cinder-84713 Aug 02 09:14:42.648491 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-bdcdb72c-cc1c-432f-ae26-d98f604dc918 req-0e347eb8-d135-4303-b8a6-577fa772e4fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034268 Aug 02 09:14:42.650914 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 500/993] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:43.373025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-bb78826d-05fb-4ab5-a1c2-18a842770dcf req-ef5f3d5a-adc8-43b5-800a-780df2f08a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370371b8-72c0-4cc6-941c-6a5f6b6c1259", "tag": "c12d0248-16ec-43cf-ad14-77f5781cc7d2"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:43.383359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-bb78826d-05fb-4ab5-a1c2-18a842770dcf req-ef5f3d5a-adc8-43b5-800a-780df2f08a57 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.383790 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-bb78826d-05fb-4ab5-a1c2-18a842770dcf req-ef5f3d5a-adc8-43b5-800a-780df2f08a57 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.395074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-bb78826d-05fb-4ab5-a1c2-18a842770dcf req-ef5f3d5a-adc8-43b5-800a-780df2f08a57 service nova] Creating event network-changed:c12d0248-16ec-43cf-ad14-77f5781cc7d2 for instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 on hv-cinder-84713 Aug 02 09:14:43.401039 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-bb78826d-05fb-4ab5-a1c2-18a842770dcf req-ef5f3d5a-adc8-43b5-800a-780df2f08a57 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031909 Aug 02 09:14:43.402676 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:43.407256 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:43.407366 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 494/994] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:43.411714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.412766 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.413543 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.414008 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.559981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:43.569368 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:43.570952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:43.572078 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fb34360d-2e9b-4905-ad31-d9ac9c5e143e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.174668 Aug 02 09:14:43.572643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 501/995] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:43 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:44.595891 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:44.597146 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:44.604912 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:44.605361 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:44.606171 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:44.606607 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:44.739970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:44.747958 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:44.749496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:44.750682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-54594ca9-1075-49ad-9224-66e388f5496f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1406 microversion: 2.20 time: 0.159022 Aug 02 09:14:44.751251 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 495/996] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:44 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:45.773485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:45.774101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:45.780796 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.781259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.782053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.782505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.914412 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.922525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.924040 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.925210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c86fd131-cf4e-4bef-9faf-e9bd21730ad6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1596 microversion: 2.20 time: 0.155685 Aug 02 09:14:45.925756 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 502/997] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:45 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1596 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:45.948675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-81549219-78a8-44b3-af76-b9c08939f31d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:45.949170 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-81549219-78a8-44b3-af76-b9c08939f31d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:45.951346 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=6 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:45.956810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-81549219-78a8-44b3-af76-b9c08939f31d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.957255 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-81549219-78a8-44b3-af76-b9c08939f31d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.958056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-81549219-78a8-44b3-af76-b9c08939f31d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.958540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-81549219-78a8-44b3-af76-b9c08939f31d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.040818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-81549219-78a8-44b3-af76-b9c08939f31d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095949 Aug 02 09:14:46.041421 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 496/998] 10.222.0.46 () {60 vars in 1316 bytes} [Tue Aug 2 09:14:45 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:14:47.084956 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-017aea58-e498-4538-9ac6-ec9443ae2a37 req-9f844f74-4f36-46b8-b6a6-7e086ab57ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea1ac8c-8116-4fed-a2e3-230762ade4b1", "tag": "7d6ddb74-8337-4c6b-9b6b-fd59368697e0"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:47.095274 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-017aea58-e498-4538-9ac6-ec9443ae2a37 req-9f844f74-4f36-46b8-b6a6-7e086ab57ea6 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.095604 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-017aea58-e498-4538-9ac6-ec9443ae2a37 req-9f844f74-4f36-46b8-b6a6-7e086ab57ea6 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:47.107673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-017aea58-e498-4538-9ac6-ec9443ae2a37 req-9f844f74-4f36-46b8-b6a6-7e086ab57ea6 service nova] Creating event network-changed:7d6ddb74-8337-4c6b-9b6b-fd59368697e0 for instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 on hv-cinder-84713 Aug 02 09:14:47.112676 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-017aea58-e498-4538-9ac6-ec9443ae2a37 req-9f844f74-4f36-46b8-b6a6-7e086ab57ea6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031925 Aug 02 09:14:47.115563 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 503/999] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:00.405165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:00.405963 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=78 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:00.410021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1684841631", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-686869677", "security_groups": [{"name": "tempest-secgroup-smoke-1123354668"}], "networks": [{"uuid": "2cca86e1-17bb-4f7e-b8bd-570a7a222bff"}], "block_device_mapping_v2": [{"uuid": "97fe78f4-479f-44f8-9780-24d18dd11204", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:00.525203 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] validate_networks() for [('2cca86e1-17bb-4f7e-b8bd-570a7a222bff', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:15:01.155695 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:15:01.156149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:15:01.156626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:15:01.157033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:15:01.157441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:15:01.167099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.167553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.168350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.168786 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.185914 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Getting quotas for project 142acfd7d2a7483083b9807280598eef. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:15:01.190465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Getting quotas for user a1300b00c7214d168e72850a8585bd47 and project 142acfd7d2a7483083b9807280598eef. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:15:01.250908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:15:01.255443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97fe78f4-479f-44f8-9780-24d18dd11204',volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:15:01.714372 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-278989bd-1961-4ff0-8f4c-254e18d8dc05 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.310163 Aug 02 09:15:01.715255 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 497/1000] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:15:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:15:01.724488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=27 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:01.725806 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=92 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:01.729858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c85019fb-f325-46dd-8d72-8a5a085df1cf tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:01.730795 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c85019fb-f325-46dd-8d72-8a5a085df1cf tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:01.788073 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c85019fb-f325-46dd-8d72-8a5a085df1cf tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:01.795148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c85019fb-f325-46dd-8d72-8a5a085df1cf tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1088 microversion: 2.1 time: 0.072816 Aug 02 09:15:01.795924 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 504/1001] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:01 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:02.818249 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b7a578af-3a4a-4ae9-89cf-a7ca94c811fd tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:02.818858 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b7a578af-3a4a-4ae9-89cf-a7ca94c811fd tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:02.826188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7a578af-3a4a-4ae9-89cf-a7ca94c811fd tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:02.826641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7a578af-3a4a-4ae9-89cf-a7ca94c811fd tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:02.827424 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7a578af-3a4a-4ae9-89cf-a7ca94c811fd tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:02.827875 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7a578af-3a4a-4ae9-89cf-a7ca94c811fd tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:02.889863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b7a578af-3a4a-4ae9-89cf-a7ca94c811fd tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:02.898684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b7a578af-3a4a-4ae9-89cf-a7ca94c811fd tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1138 microversion: 2.1 time: 0.085384 Aug 02 09:15:02.899253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 498/1002] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:02 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:03.919640 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5f91d803-4575-4334-b1a2-a5c1d5f647dc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:03.920267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5f91d803-4575-4334-b1a2-a5c1d5f647dc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:03.927796 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5f91d803-4575-4334-b1a2-a5c1d5f647dc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:03.928241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5f91d803-4575-4334-b1a2-a5c1d5f647dc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:03.929014 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5f91d803-4575-4334-b1a2-a5c1d5f647dc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:03.929439 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5f91d803-4575-4334-b1a2-a5c1d5f647dc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:03.994522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5f91d803-4575-4334-b1a2-a5c1d5f647dc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:04.002484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5f91d803-4575-4334-b1a2-a5c1d5f647dc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1186 microversion: 2.1 time: 0.086688 Aug 02 09:15:04.003067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 505/1003] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:03 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:05.024646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3baa08e0-09c5-4a32-a84d-4ea49c772cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:05.025276 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3baa08e0-09c5-4a32-a84d-4ea49c772cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:05.032529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3baa08e0-09c5-4a32-a84d-4ea49c772cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.032970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3baa08e0-09c5-4a32-a84d-4ea49c772cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.033740 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3baa08e0-09c5-4a32-a84d-4ea49c772cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.034229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3baa08e0-09c5-4a32-a84d-4ea49c772cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.141425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3baa08e0-09c5-4a32-a84d-4ea49c772cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:05.150481 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3baa08e0-09c5-4a32-a84d-4ea49c772cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1204 microversion: 2.1 time: 0.129591 Aug 02 09:15:05.151060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 499/1004] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:05 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1204 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:06.172102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1339c05c-ccfa-46b1-90bc-c5d0878baf34 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:06.172711 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1339c05c-ccfa-46b1-90bc-c5d0878baf34 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:06.180063 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1339c05c-ccfa-46b1-90bc-c5d0878baf34 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.180518 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1339c05c-ccfa-46b1-90bc-c5d0878baf34 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.181290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1339c05c-ccfa-46b1-90bc-c5d0878baf34 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.181722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1339c05c-ccfa-46b1-90bc-c5d0878baf34 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.330376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1339c05c-ccfa-46b1-90bc-c5d0878baf34 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:06.342005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1339c05c-ccfa-46b1-90bc-c5d0878baf34 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1272 microversion: 2.1 time: 0.173724 Aug 02 09:15:06.342590 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 506/1005] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:06 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:06.752009 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-e452bbab-9bac-41a5-a603-47c439b44c17 req-00f93ac6-2739-430e-8e7b-d082856eee95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7229a9c-5e58-4508-815a-5b5c0ed5f54b", "tag": "5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:06.764411 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-e452bbab-9bac-41a5-a603-47c439b44c17 req-00f93ac6-2739-430e-8e7b-d082856eee95 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.764863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-e452bbab-9bac-41a5-a603-47c439b44c17 req-00f93ac6-2739-430e-8e7b-d082856eee95 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.777065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-e452bbab-9bac-41a5-a603-47c439b44c17 req-00f93ac6-2739-430e-8e7b-d082856eee95 service nova] Creating event network-changed:5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11 for instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b on hv-cinder-84713 Aug 02 09:15:06.782577 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-e452bbab-9bac-41a5-a603-47c439b44c17 req-00f93ac6-2739-430e-8e7b-d082856eee95 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034278 Aug 02 09:15:06.783534 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 500/1006] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:07.364535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-073b60ce-404b-4cbc-b7cb-1728082a06f9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:07.365128 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-073b60ce-404b-4cbc-b7cb-1728082a06f9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:07.372405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-073b60ce-404b-4cbc-b7cb-1728082a06f9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.372891 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-073b60ce-404b-4cbc-b7cb-1728082a06f9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.373979 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-073b60ce-404b-4cbc-b7cb-1728082a06f9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.374401 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-073b60ce-404b-4cbc-b7cb-1728082a06f9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.520709 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-073b60ce-404b-4cbc-b7cb-1728082a06f9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:07.528965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-073b60ce-404b-4cbc-b7cb-1728082a06f9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.168946 Aug 02 09:15:07.529382 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 507/1007] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:07 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:08.550886 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-96630c78-70be-4782-b192-86e0a420ab11 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:08.551647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-96630c78-70be-4782-b192-86e0a420ab11 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:08.559034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96630c78-70be-4782-b192-86e0a420ab11 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.559494 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96630c78-70be-4782-b192-86e0a420ab11 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.560267 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96630c78-70be-4782-b192-86e0a420ab11 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.560704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-96630c78-70be-4782-b192-86e0a420ab11 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.705948 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-96630c78-70be-4782-b192-86e0a420ab11 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:08.713505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-96630c78-70be-4782-b192-86e0a420ab11 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.166950 Aug 02 09:15:08.714227 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 501/1008] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:08 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:09.734356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-24d0445e-7baa-4056-904c-fbe4bfdeb872 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:09.734998 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-24d0445e-7baa-4056-904c-fbe4bfdeb872 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:09.740996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-24d0445e-7baa-4056-904c-fbe4bfdeb872 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:09.741446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-24d0445e-7baa-4056-904c-fbe4bfdeb872 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:09.742233 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-24d0445e-7baa-4056-904c-fbe4bfdeb872 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:09.742664 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-24d0445e-7baa-4056-904c-fbe4bfdeb872 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:09.893744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-24d0445e-7baa-4056-904c-fbe4bfdeb872 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:09.895275 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-24d0445e-7baa-4056-904c-fbe4bfdeb872 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.164976 Aug 02 09:15:09.895840 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 508/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:09 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:10.917344 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-da33c344-1dd7-44b1-b234-71530d9a6aff tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:10.917989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-da33c344-1dd7-44b1-b234-71530d9a6aff tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:10.924887 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-da33c344-1dd7-44b1-b234-71530d9a6aff tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.925333 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-da33c344-1dd7-44b1-b234-71530d9a6aff tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.926139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-da33c344-1dd7-44b1-b234-71530d9a6aff tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.926577 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-da33c344-1dd7-44b1-b234-71530d9a6aff tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.061606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-da33c344-1dd7-44b1-b234-71530d9a6aff tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.069288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-da33c344-1dd7-44b1-b234-71530d9a6aff tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.155934 Aug 02 09:15:11.069850 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 502/1010] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:10 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:12.090347 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-47af82f5-cbe2-4336-81a7-0fd8024d45ce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:12.090905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-47af82f5-cbe2-4336-81a7-0fd8024d45ce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:12.093288 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:12.098573 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-47af82f5-cbe2-4336-81a7-0fd8024d45ce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.099029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-47af82f5-cbe2-4336-81a7-0fd8024d45ce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.100298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-47af82f5-cbe2-4336-81a7-0fd8024d45ce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.100734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-47af82f5-cbe2-4336-81a7-0fd8024d45ce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.241874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-47af82f5-cbe2-4336-81a7-0fd8024d45ce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.249299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-47af82f5-cbe2-4336-81a7-0fd8024d45ce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.163013 Aug 02 09:15:12.249877 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 509/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:12 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:13.272954 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a42761e1-c30f-44b4-a475-098bd3de9717 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:13.273559 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a42761e1-c30f-44b4-a475-098bd3de9717 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:13.275531 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:13.276198 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=6 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:13.281519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a42761e1-c30f-44b4-a475-098bd3de9717 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.281991 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a42761e1-c30f-44b4-a475-098bd3de9717 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.282755 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a42761e1-c30f-44b4-a475-098bd3de9717 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.283188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a42761e1-c30f-44b4-a475-098bd3de9717 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.421364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a42761e1-c30f-44b4-a475-098bd3de9717 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:13.429568 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a42761e1-c30f-44b4-a475-098bd3de9717 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.162392 Aug 02 09:15:13.430176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 503/1012] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:13 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:14.450824 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c2a13a79-cfed-4be0-8c36-1b38f2b1bfce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:14.451423 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c2a13a79-cfed-4be0-8c36-1b38f2b1bfce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:14.457921 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c2a13a79-cfed-4be0-8c36-1b38f2b1bfce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.458363 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c2a13a79-cfed-4be0-8c36-1b38f2b1bfce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.459202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c2a13a79-cfed-4be0-8c36-1b38f2b1bfce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.459601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c2a13a79-cfed-4be0-8c36-1b38f2b1bfce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.594988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c2a13a79-cfed-4be0-8c36-1b38f2b1bfce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:14.603140 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c2a13a79-cfed-4be0-8c36-1b38f2b1bfce tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.156204 Aug 02 09:15:14.603713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 510/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:14 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:15.624092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-75ee6349-75d1-4687-898d-3f7e918b5a58 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:15.624781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-75ee6349-75d1-4687-898d-3f7e918b5a58 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:15.631962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-75ee6349-75d1-4687-898d-3f7e918b5a58 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:15.632407 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-75ee6349-75d1-4687-898d-3f7e918b5a58 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.633180 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-75ee6349-75d1-4687-898d-3f7e918b5a58 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:15.633615 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-75ee6349-75d1-4687-898d-3f7e918b5a58 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.769647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-75ee6349-75d1-4687-898d-3f7e918b5a58 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.777434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-75ee6349-75d1-4687-898d-3f7e918b5a58 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.157265 Aug 02 09:15:15.778027 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 504/1014] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:15 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:16.799126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d0e207a9-1749-4651-a948-bd7205fb265e tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:16.801274 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d0e207a9-1749-4651-a948-bd7205fb265e tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:16.806828 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d0e207a9-1749-4651-a948-bd7205fb265e tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.807270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d0e207a9-1749-4651-a948-bd7205fb265e tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.808055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d0e207a9-1749-4651-a948-bd7205fb265e tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.808493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d0e207a9-1749-4651-a948-bd7205fb265e tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.946219 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d0e207a9-1749-4651-a948-bd7205fb265e tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:16.954141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d0e207a9-1749-4651-a948-bd7205fb265e tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.158876 Aug 02 09:15:16.954717 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 511/1015] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:16 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:17.976400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-562688de-46ee-46dd-85a5-d0990180b818 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:17.977020 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-562688de-46ee-46dd-85a5-d0990180b818 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:17.983807 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-562688de-46ee-46dd-85a5-d0990180b818 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.984250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-562688de-46ee-46dd-85a5-d0990180b818 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.985017 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-562688de-46ee-46dd-85a5-d0990180b818 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.985450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-562688de-46ee-46dd-85a5-d0990180b818 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.122791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-562688de-46ee-46dd-85a5-d0990180b818 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.130808 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-562688de-46ee-46dd-85a5-d0990180b818 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.157871 Aug 02 09:15:18.131384 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 505/1016] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:17 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:18.831424 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-370ea0e8-00db-47f6-bd9b-b3dd5b585d74 req-56250a18-f7c4-4eb6-9ac3-b0ef46f77ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7229a9c-5e58-4508-815a-5b5c0ed5f54b", "name": "network-vif-plugged", "status": "completed", "tag": "5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:18.842018 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-370ea0e8-00db-47f6-bd9b-b3dd5b585d74 req-56250a18-f7c4-4eb6-9ac3-b0ef46f77ceb service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.842466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-370ea0e8-00db-47f6-bd9b-b3dd5b585d74 req-56250a18-f7c4-4eb6-9ac3-b0ef46f77ceb service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.854450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-370ea0e8-00db-47f6-bd9b-b3dd5b585d74 req-56250a18-f7c4-4eb6-9ac3-b0ef46f77ceb service nova] Creating event network-vif-plugged:5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11 for instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b on hv-cinder-84713 Aug 02 09:15:18.863154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-370ea0e8-00db-47f6-bd9b-b3dd5b585d74 req-56250a18-f7c4-4eb6-9ac3-b0ef46f77ceb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Aug 02 09:15:18.863154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 512/1017] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:19.154293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7badcb1c-9e91-483a-8050-f7b168b15de6 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:19.154293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7badcb1c-9e91-483a-8050-f7b168b15de6 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:19.162037 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7badcb1c-9e91-483a-8050-f7b168b15de6 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.162489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7badcb1c-9e91-483a-8050-f7b168b15de6 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.164372 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7badcb1c-9e91-483a-8050-f7b168b15de6 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.164816 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7badcb1c-9e91-483a-8050-f7b168b15de6 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.338124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7badcb1c-9e91-483a-8050-f7b168b15de6 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.346045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7badcb1c-9e91-483a-8050-f7b168b15de6 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.197350 Aug 02 09:15:19.346627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 506/1018] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:19 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:20.369527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-58326145-9bc6-4a0f-af53-b081d34b1ce4 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.370230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-58326145-9bc6-4a0f-af53-b081d34b1ce4 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.376377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58326145-9bc6-4a0f-af53-b081d34b1ce4 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.376822 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58326145-9bc6-4a0f-af53-b081d34b1ce4 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.377587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58326145-9bc6-4a0f-af53-b081d34b1ce4 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.378055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-58326145-9bc6-4a0f-af53-b081d34b1ce4 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.506104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-41d49814-154f-4577-a891-9231fa98f6b4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.506682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-41d49814-154f-4577-a891-9231fa98f6b4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.513096 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-41d49814-154f-4577-a891-9231fa98f6b4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.513555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-41d49814-154f-4577-a891-9231fa98f6b4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.514355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-41d49814-154f-4577-a891-9231fa98f6b4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.514794 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-41d49814-154f-4577-a891-9231fa98f6b4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.530190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-58326145-9bc6-4a0f-af53-b081d34b1ce4 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:20.538293 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-58326145-9bc6-4a0f-af53-b081d34b1ce4 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.174041 Aug 02 09:15:20.538879 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 513/1019] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:20 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:20.598653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-41d49814-154f-4577-a891-9231fa98f6b4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lazy-loading 'services' on Instance uuid b93fca05-bed7-45c7-93fb-47a31cdf58f6 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:20.792222 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-41d49814-154f-4577-a891-9231fa98f6b4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments/0316c227-22c0-446e-955d-3831f7bfd449" status: 202 len: 0 microversion: 2.1 time: 0.289903 Aug 02 09:15:20.792823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 507/1020] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:15:20 2022] DELETE /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments/0316c227-22c0-446e-955d-3831f7bfd449 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:15:20.801490 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a5e37b44-d4bf-457c-9a90-a72d1dc4d572 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.803683 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a5e37b44-d4bf-457c-9a90-a72d1dc4d572 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.809821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a5e37b44-d4bf-457c-9a90-a72d1dc4d572 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.810298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a5e37b44-d4bf-457c-9a90-a72d1dc4d572 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.811072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a5e37b44-d4bf-457c-9a90-a72d1dc4d572 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.811514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a5e37b44-d4bf-457c-9a90-a72d1dc4d572 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.842234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a5e37b44-d4bf-457c-9a90-a72d1dc4d572 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 Aug 02 09:15:20.842804 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 514/1021] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:15:20 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:21.560483 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b553fd0c-13a7-410f-8474-495c0634ba36 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:21.561282 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b553fd0c-13a7-410f-8474-495c0634ba36 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:21.570722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b553fd0c-13a7-410f-8474-495c0634ba36 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.571130 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b553fd0c-13a7-410f-8474-495c0634ba36 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.571920 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b553fd0c-13a7-410f-8474-495c0634ba36 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.572348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b553fd0c-13a7-410f-8474-495c0634ba36 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.710657 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b553fd0c-13a7-410f-8474-495c0634ba36 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:21.718091 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b553fd0c-13a7-410f-8474-495c0634ba36 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1260 microversion: 2.1 time: 0.162290 Aug 02 09:15:21.718655 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 508/1022] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:21 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:21.855897 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1883fd7c-f46b-425b-8fe0-3990d394279a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:21.858111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1883fd7c-f46b-425b-8fe0-3990d394279a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:21.865516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1883fd7c-f46b-425b-8fe0-3990d394279a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.866005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1883fd7c-f46b-425b-8fe0-3990d394279a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.866786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1883fd7c-f46b-425b-8fe0-3990d394279a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.867218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1883fd7c-f46b-425b-8fe0-3990d394279a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.896316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1883fd7c-f46b-425b-8fe0-3990d394279a tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Aug 02 09:15:21.896874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 515/1023] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:15:21 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:22.740004 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c6c3b263-06bf-422e-9e44-915a6a6ba31f tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.740672 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c6c3b263-06bf-422e-9e44-915a6a6ba31f tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.747657 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c6c3b263-06bf-422e-9e44-915a6a6ba31f tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.748110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c6c3b263-06bf-422e-9e44-915a6a6ba31f tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.748878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c6c3b263-06bf-422e-9e44-915a6a6ba31f tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.754523 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c6c3b263-06bf-422e-9e44-915a6a6ba31f tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.888756 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c6c3b263-06bf-422e-9e44-915a6a6ba31f tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.896371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c6c3b263-06bf-422e-9e44-915a6a6ba31f tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1444 microversion: 2.1 time: 0.160429 Aug 02 09:15:22.897445 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 509/1024] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:22.908783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b2c6c04d-38c8-43a3-bf2e-1605374c224c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.911030 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b2c6c04d-38c8-43a3-bf2e-1605374c224c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.918655 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b2c6c04d-38c8-43a3-bf2e-1605374c224c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.919086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3227d3c5-3fed-45fd-b310-093889916bcb tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.919218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b2c6c04d-38c8-43a3-bf2e-1605374c224c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.919872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b2c6c04d-38c8-43a3-bf2e-1605374c224c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.920057 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3227d3c5-3fed-45fd-b310-093889916bcb tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.920311 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b2c6c04d-38c8-43a3-bf2e-1605374c224c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.926641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3227d3c5-3fed-45fd-b310-093889916bcb tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.927095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3227d3c5-3fed-45fd-b310-093889916bcb tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.928354 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3227d3c5-3fed-45fd-b310-093889916bcb tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.928798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3227d3c5-3fed-45fd-b310-093889916bcb tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.950940 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b2c6c04d-38c8-43a3-bf2e-1605374c224c tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045667 Aug 02 09:15:22.951293 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 516/1025] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:15:23.029987 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b7b5717d-8ce2-43be-9647-4bb08c1a5735 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:23.030488 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b7b5717d-8ce2-43be-9647-4bb08c1a5735 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:23.036881 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b7b5717d-8ce2-43be-9647-4bb08c1a5735 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.037328 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b7b5717d-8ce2-43be-9647-4bb08c1a5735 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.038782 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b7b5717d-8ce2-43be-9647-4bb08c1a5735 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.039221 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b7b5717d-8ce2-43be-9647-4bb08c1a5735 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.067106 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b7b5717d-8ce2-43be-9647-4bb08c1a5735 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:15:23.081725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3227d3c5-3fed-45fd-b310-093889916bcb tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:23.089686 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3227d3c5-3fed-45fd-b310-093889916bcb tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1444 microversion: 2.1 time: 0.175309 Aug 02 09:15:23.090299 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 510/1026] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:23.336206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b7b5717d-8ce2-43be-9647-4bb08c1a5735 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 204 len: 0 microversion: 2.1 time: 0.309939 Aug 02 09:15:23.336907 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 517/1027] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:15:23 2022] DELETE /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:15:23.344987 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-36491d99-fcc9-4fcc-a7d2-973e3dd69f6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:23.346011 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-36491d99-fcc9-4fcc-a7d2-973e3dd69f6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:23.351984 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36491d99-fcc9-4fcc-a7d2-973e3dd69f6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.352443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36491d99-fcc9-4fcc-a7d2-973e3dd69f6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.353415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36491d99-fcc9-4fcc-a7d2-973e3dd69f6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.353870 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36491d99-fcc9-4fcc-a7d2-973e3dd69f6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.499399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-36491d99-fcc9-4fcc-a7d2-973e3dd69f6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:23.508172 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-36491d99-fcc9-4fcc-a7d2-973e3dd69f6f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1687 microversion: 2.1 time: 0.167175 Aug 02 09:15:23.508758 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 511/1028] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:23 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:24.530026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a2b68acc-399a-42db-8b51-6f8384755026 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:24.530973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a2b68acc-399a-42db-8b51-6f8384755026 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:24.538066 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a2b68acc-399a-42db-8b51-6f8384755026 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.538538 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a2b68acc-399a-42db-8b51-6f8384755026 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.539311 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a2b68acc-399a-42db-8b51-6f8384755026 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.539739 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a2b68acc-399a-42db-8b51-6f8384755026 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.752961 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a2b68acc-399a-42db-8b51-6f8384755026 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:24.761055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a2b68acc-399a-42db-8b51-6f8384755026 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1687 microversion: 2.1 time: 0.235281 Aug 02 09:15:24.761622 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 518/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:24 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:25.432010 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-ad55e1ce-832a-46b4-a2dc-b3e4417f6e0b req-65128fe8-29f4-439f-8f0a-4423217b7094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7229a9c-5e58-4508-815a-5b5c0ed5f54b", "tag": "5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:25.443488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-ad55e1ce-832a-46b4-a2dc-b3e4417f6e0b req-65128fe8-29f4-439f-8f0a-4423217b7094 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.444569 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-ad55e1ce-832a-46b4-a2dc-b3e4417f6e0b req-65128fe8-29f4-439f-8f0a-4423217b7094 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.456545 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-ad55e1ce-832a-46b4-a2dc-b3e4417f6e0b req-65128fe8-29f4-439f-8f0a-4423217b7094 service nova] Creating event network-changed:5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11 for instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b on hv-cinder-84713 Aug 02 09:15:25.462822 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-ad55e1ce-832a-46b4-a2dc-b3e4417f6e0b req-65128fe8-29f4-439f-8f0a-4423217b7094 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034701 Aug 02 09:15:25.463807 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 512/1030] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:25.794099 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8767dcb3-a74d-416a-bfab-11bc254f8511 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:25.794704 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8767dcb3-a74d-416a-bfab-11bc254f8511 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:25.802072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8767dcb3-a74d-416a-bfab-11bc254f8511 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.802828 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8767dcb3-a74d-416a-bfab-11bc254f8511 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.804437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8767dcb3-a74d-416a-bfab-11bc254f8511 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.805096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8767dcb3-a74d-416a-bfab-11bc254f8511 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.949080 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8767dcb3-a74d-416a-bfab-11bc254f8511 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:25.957738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8767dcb3-a74d-416a-bfab-11bc254f8511 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1687 microversion: 2.1 time: 0.175132 Aug 02 09:15:25.958363 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 519/1031] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:25 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:26.981116 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b89c95ab-9801-44b6-a7ec-0d2813498bc0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:26.981976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b89c95ab-9801-44b6-a7ec-0d2813498bc0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:26.988571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b89c95ab-9801-44b6-a7ec-0d2813498bc0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:26.989134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b89c95ab-9801-44b6-a7ec-0d2813498bc0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:26.990010 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b89c95ab-9801-44b6-a7ec-0d2813498bc0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:26.990547 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b89c95ab-9801-44b6-a7ec-0d2813498bc0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.089806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b89c95ab-9801-44b6-a7ec-0d2813498bc0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:27.097419 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b89c95ab-9801-44b6-a7ec-0d2813498bc0 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1620 microversion: 2.1 time: 0.121497 Aug 02 09:15:27.098006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 513/1032] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:26 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1620 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:27.205148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-a0223d8c-dbbb-4160-8748-ce758e2b296c req-c6551dd6-71a1-4373-bd0d-8b086f7e6d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93fca05-bed7-45c7-93fb-47a31cdf58f6", "name": "network-vif-deleted", "tag": "c69e6c6c-a629-4816-a638-07c69b3b85b0"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:27.216027 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-a0223d8c-dbbb-4160-8748-ce758e2b296c req-c6551dd6-71a1-4373-bd0d-8b086f7e6d4f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.216465 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-a0223d8c-dbbb-4160-8748-ce758e2b296c req-c6551dd6-71a1-4373-bd0d-8b086f7e6d4f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.228182 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-a0223d8c-dbbb-4160-8748-ce758e2b296c req-c6551dd6-71a1-4373-bd0d-8b086f7e6d4f service nova] Creating event network-vif-deleted:c69e6c6c-a629-4816-a638-07c69b3b85b0 for instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 on hv-cinder-84713 Aug 02 09:15:27.233264 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-a0223d8c-dbbb-4160-8748-ce758e2b296c req-c6551dd6-71a1-4373-bd0d-8b086f7e6d4f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035208 Aug 02 09:15:27.233858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 520/1033] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:28.118661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:28.119266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:28.126001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.126456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.127234 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.127670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.171620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.172105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.172538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lazy-loading 'fault' on Instance uuid b93fca05-bed7-45c7-93fb-47a31cdf58f6 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:28.175924 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:28.217109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:28.225715 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-61a1d2c8-8645-49d6-ab73-e02c8cd9fcd9 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 200 len: 1335 microversion: 2.1 time: 0.110899 Aug 02 09:15:28.226387 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 514/1034] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:28 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:29.248714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:29.249275 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: b93fca05-bed7-45c7-93fb-47a31cdf58f6] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:29.255663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.256115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.257376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.257814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.261810 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:29.270818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] HTTP exception thrown: Instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 could not be found. Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Request method failure captured: Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 HTTP/1.1 Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkUtiZTGQAKR0dnal4vCTJhYWvzTPJv-sAIuyoSTn45EtNUdfqxAymXsvlQ2XliECiosiusjoT-xAJPEVdetmgxFh17XLW49kaAKo2J-oUceW7KA8uCZueHdpSeFK8W79HENaYFsQLGqtE4eO-1Lf0taojSxSbXWPVAggEdLBKn6t8 Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:15:29.278188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_259e864bb08645c79dfab23aa56d8822"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 7fd6b148658e4c2884a32f66326833b6 Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 could not be found. Aug 02 09:15:29.279875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'b93fca05-bed7-45c7-93fb-47a31cdf58f6'} Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 could not be found. Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:15:29.280814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 could not be found. Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 could not be found. Aug 02 09:15:29.282496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:15:29.283875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Returning 404 to user: Instance b93fca05-bed7-45c7-93fb-47a31cdf58f6 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:15:29.283875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-96e6b7dd-d446-4358-b3e4-8c6a84f8fecd tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6" status: 404 len: 111 microversion: 2.1 time: 0.030663 Aug 02 09:15:29.283875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 521/1035] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:29 2022] GET /compute/v2.1/servers/b93fca05-bed7-45c7-93fb-47a31cdf58f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:15:29.284139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c228d44d-2717-4dad-9f8d-a55841468e4f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '.version_select at 0x7f0f2d647310>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:29.356948 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c228d44d-2717-4dad-9f8d-a55841468e4f tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851297679" status: 202 len: 0 microversion: 2.1 time: 0.077372 Aug 02 09:15:29.357589 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 515/1036] 10.222.0.46 () {58 vars in 1221 bytes} [Tue Aug 2 09:15:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851297679 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:15:32.734483 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-112b21c9-db86-4a9b-99f1-8cdd57481743 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:32.735044 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-112b21c9-db86-4a9b-99f1-8cdd57481743 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:32.737654 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:32.742933 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-112b21c9-db86-4a9b-99f1-8cdd57481743 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.743385 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-112b21c9-db86-4a9b-99f1-8cdd57481743 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.744165 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-112b21c9-db86-4a9b-99f1-8cdd57481743 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.744606 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-112b21c9-db86-4a9b-99f1-8cdd57481743 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.770754 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-112b21c9-db86-4a9b-99f1-8cdd57481743 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:15:33.104565 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-112b21c9-db86-4a9b-99f1-8cdd57481743 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 204 len: 0 microversion: 2.1 time: 0.373657 Aug 02 09:15:33.105329 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 522/1037] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:15:32 2022] DELETE /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:15:33.113624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-380ace3f-3a01-494f-80ac-9718256fbcea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:33.114269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-380ace3f-3a01-494f-80ac-9718256fbcea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:33.116200 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:33.121187 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-380ace3f-3a01-494f-80ac-9718256fbcea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.121636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-380ace3f-3a01-494f-80ac-9718256fbcea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.122439 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-380ace3f-3a01-494f-80ac-9718256fbcea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.122873 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-380ace3f-3a01-494f-80ac-9718256fbcea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.264104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-380ace3f-3a01-494f-80ac-9718256fbcea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:33.271550 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-380ace3f-3a01-494f-80ac-9718256fbcea tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1508 microversion: 2.1 time: 0.161956 Aug 02 09:15:33.272107 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 516/1038] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:33 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:34.293430 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a275f239-d4c6-4e97-a625-133ce0598d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:34.294256 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a275f239-d4c6-4e97-a625-133ce0598d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:34.301267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a275f239-d4c6-4e97-a625-133ce0598d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.301713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a275f239-d4c6-4e97-a625-133ce0598d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.302524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a275f239-d4c6-4e97-a625-133ce0598d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.302961 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a275f239-d4c6-4e97-a625-133ce0598d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.455226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a275f239-d4c6-4e97-a625-133ce0598d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:34.463133 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a275f239-d4c6-4e97-a625-133ce0598d40 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1508 microversion: 2.1 time: 0.174109 Aug 02 09:15:34.463706 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 523/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:34 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:34.834712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-ff4089a5-45c4-4899-b587-34d47f0dbb47 req-697de5c3-d896-43c5-b8f9-cd9f10a757ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b281103-e2e9-4a29-93a6-80ef8943841a", "name": "network-vif-deleted", "tag": "9239d9b4-016e-4388-8e77-96d7b816177a"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:34.845699 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-ff4089a5-45c4-4899-b587-34d47f0dbb47 req-697de5c3-d896-43c5-b8f9-cd9f10a757ad service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.846279 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-ff4089a5-45c4-4899-b587-34d47f0dbb47 req-697de5c3-d896-43c5-b8f9-cd9f10a757ad service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.859085 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-ff4089a5-45c4-4899-b587-34d47f0dbb47 req-697de5c3-d896-43c5-b8f9-cd9f10a757ad service nova] Creating event network-vif-deleted:9239d9b4-016e-4388-8e77-96d7b816177a for instance 6b281103-e2e9-4a29-93a6-80ef8943841a on hv-cinder-84713 Aug 02 09:15:34.867447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-ff4089a5-45c4-4899-b587-34d47f0dbb47 req-697de5c3-d896-43c5-b8f9-cd9f10a757ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036740 Aug 02 09:15:34.868569 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 517/1040] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:35.484440 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:35.489419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:35.496682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.497135 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.497935 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.498379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.528870 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.529318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.529773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lazy-loading 'fault' on Instance uuid 6b281103-e2e9-4a29-93a6-80ef8943841a {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:35.574340 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:35.582116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1409baa8-a8de-4853-97ec-25e1b7ab55a6 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 200 len: 1312 microversion: 2.1 time: 0.101430 Aug 02 09:15:35.582791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 524/1041] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:35 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:36.604270 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:36.604953 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 6b281103-e2e9-4a29-93a6-80ef8943841a] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:36.611676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.612123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.612885 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.613315 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.626802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] HTTP exception thrown: Instance 6b281103-e2e9-4a29-93a6-80ef8943841a could not be found. Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Request method failure captured: Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a HTTP/1.1 Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkUtiZTGQAKR0dnal4vCTJhYWvzTPJv-sAIuyoSTn45EtNUdfqxAymXsvlQ2XliECiosiusjoT-xAJPEVdetmgxFh17XLW49kaAKo2J-oUceW7KA8uCZueHdpSeFK8W79HENaYFsQLGqtE4eO-1Lf0taojSxSbXWPVAggEdLBKn6t8 Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:15:36.628554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_259e864bb08645c79dfab23aa56d8822"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 7fd6b148658e4c2884a32f66326833b6 Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 6b281103-e2e9-4a29-93a6-80ef8943841a could not be found. Aug 02 09:15:36.631626 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '6b281103-e2e9-4a29-93a6-80ef8943841a'} Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b281103-e2e9-4a29-93a6-80ef8943841a could not be found. Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:15:36.632389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b281103-e2e9-4a29-93a6-80ef8943841a could not be found. Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b281103-e2e9-4a29-93a6-80ef8943841a could not be found. Aug 02 09:15:36.634144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:36.636015 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Returning 404 to user: Instance 6b281103-e2e9-4a29-93a6-80ef8943841a could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:15:36.636015 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b708abd5-c004-4ad8-a7a8-8d292b82c240 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a" status: 404 len: 111 microversion: 2.1 time: 0.030447 Aug 02 09:15:36.636015 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 518/1042] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:36 2022] GET /compute/v2.1/servers/6b281103-e2e9-4a29-93a6-80ef8943841a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:15:36.640669 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6269f4e3-237d-4df6-839e-50c180ba5da4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:36.641172 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6269f4e3-237d-4df6-839e-50c180ba5da4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:36.647837 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6269f4e3-237d-4df6-839e-50c180ba5da4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.648284 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6269f4e3-237d-4df6-839e-50c180ba5da4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.649634 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6269f4e3-237d-4df6-839e-50c180ba5da4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.650102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6269f4e3-237d-4df6-839e-50c180ba5da4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.675032 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6269f4e3-237d-4df6-839e-50c180ba5da4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:15:36.968812 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6269f4e3-237d-4df6-839e-50c180ba5da4 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "DELETE /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 204 len: 0 microversion: 2.1 time: 0.331460 Aug 02 09:15:36.969225 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 525/1043] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:15:36 2022] DELETE /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:15:36.977151 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b21e4380-24f6-47bf-a173-d031efd89f62 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:36.982151 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b21e4380-24f6-47bf-a173-d031efd89f62 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:36.985125 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b21e4380-24f6-47bf-a173-d031efd89f62 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.985570 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b21e4380-24f6-47bf-a173-d031efd89f62 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.986372 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b21e4380-24f6-47bf-a173-d031efd89f62 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.986800 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b21e4380-24f6-47bf-a173-d031efd89f62 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:37.116916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b21e4380-24f6-47bf-a173-d031efd89f62 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:37.125314 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b21e4380-24f6-47bf-a173-d031efd89f62 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.152026 Aug 02 09:15:37.125956 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 519/1044] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:36 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:38.148284 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3240ad2d-4949-4041-a851-14712b7f8edf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:38.148991 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3240ad2d-4949-4041-a851-14712b7f8edf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:38.155600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3240ad2d-4949-4041-a851-14712b7f8edf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.156046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3240ad2d-4949-4041-a851-14712b7f8edf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.156851 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3240ad2d-4949-4041-a851-14712b7f8edf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.157282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3240ad2d-4949-4041-a851-14712b7f8edf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.289920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3240ad2d-4949-4041-a851-14712b7f8edf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:38.297786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3240ad2d-4949-4041-a851-14712b7f8edf tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1520 microversion: 2.1 time: 0.153697 Aug 02 09:15:38.298396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 526/1045] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:38 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:38.553375 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-2352374c-ad04-4e24-b172-112aada56151 req-8cf7e085-0e93-47ab-b5e2-65d20973f9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b73e88-9298-4f0b-b36b-069907a1a076", "name": "network-vif-deleted", "tag": "700a8b29-8689-4aad-9e57-8bd3ebc77848"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:38.563833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-2352374c-ad04-4e24-b172-112aada56151 req-8cf7e085-0e93-47ab-b5e2-65d20973f9f0 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.564378 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-2352374c-ad04-4e24-b172-112aada56151 req-8cf7e085-0e93-47ab-b5e2-65d20973f9f0 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.575474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-2352374c-ad04-4e24-b172-112aada56151 req-8cf7e085-0e93-47ab-b5e2-65d20973f9f0 service nova] Creating event network-vif-deleted:700a8b29-8689-4aad-9e57-8bd3ebc77848 for instance 03b73e88-9298-4f0b-b36b-069907a1a076 on hv-cinder-84713 Aug 02 09:15:38.580193 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-2352374c-ad04-4e24-b172-112aada56151 req-8cf7e085-0e93-47ab-b5e2-65d20973f9f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030586 Aug 02 09:15:38.580781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 520/1046] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:39.325377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:39.326012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:39.332049 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.336160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.336160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.336160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.364175 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.364643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.365076 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lazy-loading 'fault' on Instance uuid 03b73e88-9298-4f0b-b36b-069907a1a076 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:39.412336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd6b148658e4c2884a32f66326833b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259e864bb08645c79dfab23aa56d8822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:39.420161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0adc5f25-7c2a-40d6-a2a9-eaf1417d7bd8 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 200 len: 1311 microversion: 2.1 time: 0.099378 Aug 02 09:15:39.423626 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 527/1047] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:39 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:40.442669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:40.443356 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] [instance: 03b73e88-9298-4f0b-b36b-069907a1a076] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:40.450182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:40.450631 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:40.451401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:40.451834 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:40.466823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] HTTP exception thrown: Instance 03b73e88-9298-4f0b-b36b-069907a1a076 could not be found. Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Request method failure captured: Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 HTTP/1.1 Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkUtiZTGQAKR0dnal4vCTJhYWvzTPJv-sAIuyoSTn45EtNUdfqxAymXsvlQ2XliECiosiusjoT-xAJPEVdetmgxFh17XLW49kaAKo2J-oUceW7KA8uCZueHdpSeFK8W79HENaYFsQLGqtE4eO-1Lf0taojSxSbXWPVAggEdLBKn6t8 Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:15:40.471728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_259e864bb08645c79dfab23aa56d8822"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259e864bb08645c79dfab23aa56d8822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 259e864bb08645c79dfab23aa56d8822 Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669895977 Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 7fd6b148658e4c2884a32f66326833b6 Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669895977-project Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 03b73e88-9298-4f0b-b36b-069907a1a076 could not be found. Aug 02 09:15:40.473343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '03b73e88-9298-4f0b-b36b-069907a1a076'} Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b73e88-9298-4f0b-b36b-069907a1a076 could not be found. Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:15:40.474517 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b73e88-9298-4f0b-b36b-069907a1a076 could not be found. Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b73e88-9298-4f0b-b36b-069907a1a076 could not be found. Aug 02 09:15:40.476447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:15:40.477802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] Returning 404 to user: Instance 03b73e88-9298-4f0b-b36b-069907a1a076 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:15:40.477802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-729b28d2-527e-449c-8b14-3a4f34ae7597 tempest-ServerRescueNegativeTestJSON-669895977 tempest-ServerRescueNegativeTestJSON-669895977-project] 10.222.0.46 "GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076" status: 404 len: 111 microversion: 2.1 time: 0.031741 Aug 02 09:15:40.477802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 521/1048] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:40 2022] GET /compute/v2.1/servers/03b73e88-9298-4f0b-b36b-069907a1a076 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:15:51.174527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:51.175114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:51.323650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-556cbe92-e0fe-44d8-a651-79f452a4c3c1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'create', calling method: .version_select at 0x7f0f2d8154c0>, body: {"keypair": {"name": "tempest-keypair-1308012122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqM/QidpCiAoYaxBkmCSdX+Z9sDwtC/2LdYT1Oj1HVuh5w4JTR9ceauUCxrNxvECjO3+M82KXGu4akBkgP06P1v53r2/jdMWWNTMkYf/E+5gmzj+abkizKbQ9SZ/BZ7Qw=="}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:51.347359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-556cbe92-e0fe-44d8-a651-79f452a4c3c1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Getting quotas for project bfaca149a97a44cf84f9d21fa65510b6. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:15:51.355664 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-556cbe92-e0fe-44d8-a651-79f452a4c3c1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Getting quotas for user 77aff587ea964860895cd4dce03f2158 and project bfaca149a97a44cf84f9d21fa65510b6. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:15:51.465443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-556cbe92-e0fe-44d8-a651-79f452a4c3c1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.296414 Aug 02 09:15:51.466112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 528/1049] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:15:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:53.698894 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2139512842", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7acbcc3f-63ce-47e1-b1eb-b196cd2049fd"}], "security_groups": [{"name": "tempest-securitygroup--1976089887"}], "key_name": "tempest-keypair-1308012122", "user_data": "}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:53.707633 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=11 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:53.713581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=22 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:53.812375 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] validate_networks() for [('7acbcc3f-63ce-47e1-b1eb-b196cd2049fd', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:15:54.206951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:15:54.207371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:15:54.208694 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:15:54.208694 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:15:54.208694 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:15:54.218891 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.219351 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.220186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.220629 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.239395 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Getting quotas for project bfaca149a97a44cf84f9d21fa65510b6. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:15:54.244060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Getting quotas for user 77aff587ea964860895cd4dce03f2158 and project bfaca149a97a44cf84f9d21fa65510b6. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:15:54.257009 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:15:54.260150 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:15:54.410804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f6ca62ab-e6da-46c4-88ba-79bc72e4beb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717370 Aug 02 09:15:54.411634 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 522/1050] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:15:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:15:54.422975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e4f64118-5823-46e9-85e9-b4c99bc0df78 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:54.424443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e4f64118-5823-46e9-85e9-b4c99bc0df78 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:54.485736 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e4f64118-5823-46e9-85e9-b4c99bc0df78 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:54.497040 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e4f64118-5823-46e9-85e9-b4c99bc0df78 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1238 microversion: 2.1 time: 0.077943 Aug 02 09:15:54.498151 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 529/1051] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:54 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:55.518061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-664bf7e0-64b4-4515-8a44-6d473023b789 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.518678 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-664bf7e0-64b4-4515-8a44-6d473023b789 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:55.528982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-664bf7e0-64b4-4515-8a44-6d473023b789 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.528982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-664bf7e0-64b4-4515-8a44-6d473023b789 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.529665 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-664bf7e0-64b4-4515-8a44-6d473023b789 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.529665 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-664bf7e0-64b4-4515-8a44-6d473023b789 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.598494 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-664bf7e0-64b4-4515-8a44-6d473023b789 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:55.606335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-664bf7e0-64b4-4515-8a44-6d473023b789 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1242 microversion: 2.1 time: 0.092564 Aug 02 09:15:55.606954 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 523/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:55 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:56.627847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a81d6852-b3b0-4b27-9d66-b62986c19cf5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:56.628408 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a81d6852-b3b0-4b27-9d66-b62986c19cf5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:56.635687 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a81d6852-b3b0-4b27-9d66-b62986c19cf5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.636110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a81d6852-b3b0-4b27-9d66-b62986c19cf5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.636869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a81d6852-b3b0-4b27-9d66-b62986c19cf5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.637294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a81d6852-b3b0-4b27-9d66-b62986c19cf5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.700399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a81d6852-b3b0-4b27-9d66-b62986c19cf5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:56.708288 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a81d6852-b3b0-4b27-9d66-b62986c19cf5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1298 microversion: 2.1 time: 0.084595 Aug 02 09:15:56.708886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 530/1053] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:56 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:57.732981 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-262c281b-b219-4eae-9272-6d7f355d7006 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:57.733675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-262c281b-b219-4eae-9272-6d7f355d7006 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:57.740784 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-262c281b-b219-4eae-9272-6d7f355d7006 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.742194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-262c281b-b219-4eae-9272-6d7f355d7006 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.743669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-262c281b-b219-4eae-9272-6d7f355d7006 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.744211 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-262c281b-b219-4eae-9272-6d7f355d7006 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.961481 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-262c281b-b219-4eae-9272-6d7f355d7006 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:57.969192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-262c281b-b219-4eae-9272-6d7f355d7006 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.240314 Aug 02 09:15:57.969869 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 524/1054] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:57 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:58.567609 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-d78e377f-6866-4e37-bacb-2d675acec190 req-ba489ece-2342-4e3d-b645-fc1cb8614665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04e0dc0-229f-4f7e-a56b-582dcc6b64fd", "tag": "b514c4a7-357e-4788-9c3b-2c6b5ae99179"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:58.578791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d78e377f-6866-4e37-bacb-2d675acec190 req-ba489ece-2342-4e3d-b645-fc1cb8614665 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.579993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d78e377f-6866-4e37-bacb-2d675acec190 req-ba489ece-2342-4e3d-b645-fc1cb8614665 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.593378 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-d78e377f-6866-4e37-bacb-2d675acec190 req-ba489ece-2342-4e3d-b645-fc1cb8614665 service nova] Creating event network-changed:b514c4a7-357e-4788-9c3b-2c6b5ae99179 for instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd on hv-cinder-84713 Aug 02 09:15:58.598335 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-d78e377f-6866-4e37-bacb-2d675acec190 req-ba489ece-2342-4e3d-b645-fc1cb8614665 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034346 Aug 02 09:15:58.599235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 531/1055] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:58.992632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-777e64ba-72e9-40f2-ae24-fc6948e3dd6b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:58.993426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-777e64ba-72e9-40f2-ae24-fc6948e3dd6b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:59.000464 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-777e64ba-72e9-40f2-ae24-fc6948e3dd6b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.007377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-777e64ba-72e9-40f2-ae24-fc6948e3dd6b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.007377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-777e64ba-72e9-40f2-ae24-fc6948e3dd6b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.007377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-777e64ba-72e9-40f2-ae24-fc6948e3dd6b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.232284 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-777e64ba-72e9-40f2-ae24-fc6948e3dd6b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:59.239732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-777e64ba-72e9-40f2-ae24-fc6948e3dd6b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.253334 Aug 02 09:15:59.240311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 525/1056] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:58 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:00.262874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-518cd1f8-3348-4778-9c94-35b656e7ae25 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:00.263594 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-518cd1f8-3348-4778-9c94-35b656e7ae25 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:00.269783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-518cd1f8-3348-4778-9c94-35b656e7ae25 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.270266 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-518cd1f8-3348-4778-9c94-35b656e7ae25 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.271031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-518cd1f8-3348-4778-9c94-35b656e7ae25 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.271502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-518cd1f8-3348-4778-9c94-35b656e7ae25 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.401988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-518cd1f8-3348-4778-9c94-35b656e7ae25 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:00.409514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-518cd1f8-3348-4778-9c94-35b656e7ae25 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.151401 Aug 02 09:16:00.410102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 532/1057] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:00 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:01.430610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-36bb24b2-2c32-4a2c-9ad2-afea744f23f5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:01.431211 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-36bb24b2-2c32-4a2c-9ad2-afea744f23f5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:01.437961 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36bb24b2-2c32-4a2c-9ad2-afea744f23f5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:01.438416 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36bb24b2-2c32-4a2c-9ad2-afea744f23f5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:01.439193 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36bb24b2-2c32-4a2c-9ad2-afea744f23f5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:01.439632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36bb24b2-2c32-4a2c-9ad2-afea744f23f5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:01.566959 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-36bb24b2-2c32-4a2c-9ad2-afea744f23f5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:01.575262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-36bb24b2-2c32-4a2c-9ad2-afea744f23f5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.148452 Aug 02 09:16:01.575826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 526/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:01 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:02.596710 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1efe777d-fd96-4b45-b8ca-f3f793b99cb1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:02.597332 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1efe777d-fd96-4b45-b8ca-f3f793b99cb1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:02.605126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1efe777d-fd96-4b45-b8ca-f3f793b99cb1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.605581 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1efe777d-fd96-4b45-b8ca-f3f793b99cb1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.606406 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1efe777d-fd96-4b45-b8ca-f3f793b99cb1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.606841 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1efe777d-fd96-4b45-b8ca-f3f793b99cb1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.739624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1efe777d-fd96-4b45-b8ca-f3f793b99cb1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:02.747273 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1efe777d-fd96-4b45-b8ca-f3f793b99cb1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.154366 Aug 02 09:16:02.747791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 533/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:02 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:03.767932 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1dd69921-6966-4b9f-ad01-c3b9ed7de154 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:03.768509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1dd69921-6966-4b9f-ad01-c3b9ed7de154 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:03.776748 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1dd69921-6966-4b9f-ad01-c3b9ed7de154 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.777160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1dd69921-6966-4b9f-ad01-c3b9ed7de154 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.777916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1dd69921-6966-4b9f-ad01-c3b9ed7de154 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.778356 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1dd69921-6966-4b9f-ad01-c3b9ed7de154 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.918240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1dd69921-6966-4b9f-ad01-c3b9ed7de154 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:03.925752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1dd69921-6966-4b9f-ad01-c3b9ed7de154 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.161836 Aug 02 09:16:03.926350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 527/1060] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:03 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:04.586912 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d05ed80c-32ae-4759-afd4-3498d6b8c6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:04.587438 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d05ed80c-32ae-4759-afd4-3498d6b8c6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:04.589833 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=6 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:04.594729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d05ed80c-32ae-4759-afd4-3498d6b8c6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.595181 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d05ed80c-32ae-4759-afd4-3498d6b8c6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.595951 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d05ed80c-32ae-4759-afd4-3498d6b8c6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.596393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d05ed80c-32ae-4759-afd4-3498d6b8c6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.619483 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d05ed80c-32ae-4759-afd4-3498d6b8c6e2 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/ips" status: 200 len: 149 microversion: 2.1 time: 0.037142 Aug 02 09:16:04.620060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 534/1061] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:16:04 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:04.949468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b1adac8d-8c40-47d7-aa4c-7985a36b5a90 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:04.950124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b1adac8d-8c40-47d7-aa4c-7985a36b5a90 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:04.952122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:04.952788 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=6 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:04.958138 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b1adac8d-8c40-47d7-aa4c-7985a36b5a90 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.958583 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b1adac8d-8c40-47d7-aa4c-7985a36b5a90 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.959416 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b1adac8d-8c40-47d7-aa4c-7985a36b5a90 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.959942 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b1adac8d-8c40-47d7-aa4c-7985a36b5a90 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.979374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-5c77df39-866a-4bd5-9c9c-66e1b74e23df req-f8858166-4c22-4ab1-8eaa-c476d8c12bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04e0dc0-229f-4f7e-a56b-582dcc6b64fd", "name": "network-vif-plugged", "status": "completed", "tag": "b514c4a7-357e-4788-9c3b-2c6b5ae99179"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:04.992799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-5c77df39-866a-4bd5-9c9c-66e1b74e23df req-f8858166-4c22-4ab1-8eaa-c476d8c12bfb service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.993432 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-5c77df39-866a-4bd5-9c9c-66e1b74e23df req-f8858166-4c22-4ab1-8eaa-c476d8c12bfb service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.005481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-5c77df39-866a-4bd5-9c9c-66e1b74e23df req-f8858166-4c22-4ab1-8eaa-c476d8c12bfb service nova] Creating event network-vif-plugged:b514c4a7-357e-4788-9c3b-2c6b5ae99179 for instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd on hv-cinder-84713 Aug 02 09:16:05.011779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-5c77df39-866a-4bd5-9c9c-66e1b74e23df req-f8858166-4c22-4ab1-8eaa-c476d8c12bfb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037364 Aug 02 09:16:05.012774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 535/1062] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:05.107961 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b1adac8d-8c40-47d7-aa4c-7985a36b5a90 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:05.116644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b1adac8d-8c40-47d7-aa4c-7985a36b5a90 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.170520 Aug 02 09:16:05.117820 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 528/1063] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:04 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:06.140747 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1c1d5959-7376-4107-94d2-ecc44e8c831f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:06.141354 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1c1d5959-7376-4107-94d2-ecc44e8c831f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:06.148497 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c1d5959-7376-4107-94d2-ecc44e8c831f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:06.148744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c1d5959-7376-4107-94d2-ecc44e8c831f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.149515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c1d5959-7376-4107-94d2-ecc44e8c831f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:06.149990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c1d5959-7376-4107-94d2-ecc44e8c831f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.285300 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1c1d5959-7376-4107-94d2-ecc44e8c831f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:06.293463 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1c1d5959-7376-4107-94d2-ecc44e8c831f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.157486 Aug 02 09:16:06.294060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 536/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:06 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:07.313959 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f5db003c-a60a-4066-a73f-53ed244b24d7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37bbcab1-f79f-4be2-9908-347e1013a3b1"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:07.314499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-59b608c8-599c-4990-8e87-69e940bc7b26 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:07.314875 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-59b608c8-599c-4990-8e87-69e940bc7b26 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.316671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f5db003c-a60a-4066-a73f-53ed244b24d7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.321865 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-59b608c8-599c-4990-8e87-69e940bc7b26 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.324688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-59b608c8-599c-4990-8e87-69e940bc7b26 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.324688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-59b608c8-599c-4990-8e87-69e940bc7b26 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.324688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-59b608c8-599c-4990-8e87-69e940bc7b26 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.325057 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f5db003c-a60a-4066-a73f-53ed244b24d7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.325541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f5db003c-a60a-4066-a73f-53ed244b24d7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.326430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f5db003c-a60a-4066-a73f-53ed244b24d7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.326866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f5db003c-a60a-4066-a73f-53ed244b24d7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.462866 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-59b608c8-599c-4990-8e87-69e940bc7b26 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:07.470283 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-59b608c8-599c-4990-8e87-69e940bc7b26 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1364 microversion: 2.1 time: 0.160281 Aug 02 09:16:07.470846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 537/1065] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:07 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:08.205037 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f5db003c-a60a-4066-a73f-53ed244b24d7 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895062 Aug 02 09:16:08.205642 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 529/1066] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:16:07 2022] POST /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:08.491082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e3c3b5e1-4efb-4b78-a0e0-b8122e3c7d23 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.492141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e3c3b5e1-4efb-4b78-a0e0-b8122e3c7d23 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.498039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3c3b5e1-4efb-4b78-a0e0-b8122e3c7d23 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.498507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3c3b5e1-4efb-4b78-a0e0-b8122e3c7d23 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.499263 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3c3b5e1-4efb-4b78-a0e0-b8122e3c7d23 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.499785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3c3b5e1-4efb-4b78-a0e0-b8122e3c7d23 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.627568 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e3c3b5e1-4efb-4b78-a0e0-b8122e3c7d23 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:08.634956 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e3c3b5e1-4efb-4b78-a0e0-b8122e3c7d23 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1550 microversion: 2.1 time: 0.147844 Aug 02 09:16:08.635557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 538/1067] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:08.655950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ae5b00b5-283c-4dbd-afa9-e2886ead247c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.656524 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ae5b00b5-283c-4dbd-afa9-e2886ead247c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.664034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae5b00b5-283c-4dbd-afa9-e2886ead247c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.664477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae5b00b5-283c-4dbd-afa9-e2886ead247c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.665235 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae5b00b5-283c-4dbd-afa9-e2886ead247c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.665666 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae5b00b5-283c-4dbd-afa9-e2886ead247c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.747401 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ae5b00b5-283c-4dbd-afa9-e2886ead247c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095587 Aug 02 09:16:08.747998 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 530/1068] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:10.042056 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-c6921b4a-5cd4-437f-8b6c-726d932f1a02 req-ed315aab-6931-431e-afa7-ef708093282f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04e0dc0-229f-4f7e-a56b-582dcc6b64fd", "tag": "b514c4a7-357e-4788-9c3b-2c6b5ae99179"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:10.051481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-c6921b4a-5cd4-437f-8b6c-726d932f1a02 req-ed315aab-6931-431e-afa7-ef708093282f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.051918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-c6921b4a-5cd4-437f-8b6c-726d932f1a02 req-ed315aab-6931-431e-afa7-ef708093282f service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.065242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-c6921b4a-5cd4-437f-8b6c-726d932f1a02 req-ed315aab-6931-431e-afa7-ef708093282f service nova] Creating event network-changed:b514c4a7-357e-4788-9c3b-2c6b5ae99179 for instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd on hv-cinder-84713 Aug 02 09:16:10.070097 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-c6921b4a-5cd4-437f-8b6c-726d932f1a02 req-ed315aab-6931-431e-afa7-ef708093282f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032436 Aug 02 09:16:10.070684 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 539/1069] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:16.792522 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37bbcab1-f79f-4be2-9908-347e1013a3b1"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:16.795035 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:16.801019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.801489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.805976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.805976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.897799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3f36af0a-98b6-4b97-8b70-3de5de949b0e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:16.898411 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3f36af0a-98b6-4b97-8b70-3de5de949b0e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:16.904747 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3f36af0a-98b6-4b97-8b70-3de5de949b0e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.905214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3f36af0a-98b6-4b97-8b70-3de5de949b0e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.906013 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3f36af0a-98b6-4b97-8b70-3de5de949b0e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.906455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3f36af0a-98b6-4b97-8b70-3de5de949b0e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.930317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3f36af0a-98b6-4b97-8b70-3de5de949b0e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/ips" status: 200 len: 150 microversion: 2.20 time: 0.037093 Aug 02 09:16:16.930821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 540/1070] 10.222.0.46 () {60 vars in 1289 bytes} [Tue Aug 2 09:16:16 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:16.988221 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Invalid volume: volume 37bbcab1-f79f-4be2-9908-347e1013a3b1 is already attached to instances: f440de7e-1c06-4efd-aa35-34b3ab64b494 Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: POST /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments HTTP/1.1 Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 74 Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:16:16.990441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {"volumeAttachment": {"volumeId": "37bbcab1-f79f-4be2-9908-347e1013a3b1"}} Aug 02 09:16:16.992669 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Invalid volume: volume 37bbcab1-f79f-4be2-9908-347e1013a3b1 is already attached to instances: f440de7e-1c06-4efd-aa35-34b3ab64b494 Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'server_id': 'f440de7e-1c06-4efd-aa35-34b3ab64b494', 'body': {'volumeAttachment': {'volumeId': '37bbcab1-f79f-4be2-9908-347e1013a3b1'}}} Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 37bbcab1-f79f-4be2-9908-347e1013a3b1 is already attached to instances: f440de7e-1c06-4efd-aa35-34b3ab64b494 Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.993593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 37bbcab1-f79f-4be2-9908-347e1013a3b1 is already attached to instances: f440de7e-1c06-4efd-aa35-34b3ab64b494 Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:16.995178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:16.997094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:16.997094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:16:16.997094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:16:16.997094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 37bbcab1-f79f-4be2-9908-347e1013a3b1 is already attached to instances: f440de7e-1c06-4efd-aa35-34b3ab64b494 Aug 02 09:16:16.997094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.997094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 400 to user: Invalid volume: volume 37bbcab1-f79f-4be2-9908-347e1013a3b1 is already attached to instances: f440de7e-1c06-4efd-aa35-34b3ab64b494 {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:16:16.997094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4fcf367b-cac7-46d9-b713-ec65e40066fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.204257 Aug 02 09:16:16.997094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 531/1071] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:16:16 2022] POST /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments => generated 174 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:16:17.056541 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-43f2bf19-7fe2-4786-a441-9cf754718a5c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:17.057070 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-43f2bf19-7fe2-4786-a441-9cf754718a5c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:17.063513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-43f2bf19-7fe2-4786-a441-9cf754718a5c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.063948 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-43f2bf19-7fe2-4786-a441-9cf754718a5c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.065103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-43f2bf19-7fe2-4786-a441-9cf754718a5c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.065103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-43f2bf19-7fe2-4786-a441-9cf754718a5c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.199048 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-43f2bf19-7fe2-4786-a441-9cf754718a5c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lazy-loading 'services' on Instance uuid f440de7e-1c06-4efd-aa35-34b3ab64b494 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:17.514505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-43f2bf19-7fe2-4786-a441-9cf754718a5c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments/37bbcab1-f79f-4be2-9908-347e1013a3b1" status: 202 len: 0 microversion: 2.1 time: 0.462163 Aug 02 09:16:17.515194 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 541/1072] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:16:17 2022] DELETE /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments/37bbcab1-f79f-4be2-9908-347e1013a3b1 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:16:17.526339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0af5edac-cd17-4fcb-a391-fced8061e39e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:17.528569 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0af5edac-cd17-4fcb-a391-fced8061e39e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:17.535834 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0af5edac-cd17-4fcb-a391-fced8061e39e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.536290 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0af5edac-cd17-4fcb-a391-fced8061e39e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.537851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0af5edac-cd17-4fcb-a391-fced8061e39e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.538502 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0af5edac-cd17-4fcb-a391-fced8061e39e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.569141 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0af5edac-cd17-4fcb-a391-fced8061e39e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047597 Aug 02 09:16:17.569987 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 532/1073] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:17 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:18.581694 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-26f37602-d9da-4c8c-a21a-8563a6db2f15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:18.584167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-26f37602-d9da-4c8c-a21a-8563a6db2f15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:18.590716 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26f37602-d9da-4c8c-a21a-8563a6db2f15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.591170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26f37602-d9da-4c8c-a21a-8563a6db2f15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.591941 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26f37602-d9da-4c8c-a21a-8563a6db2f15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.592378 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26f37602-d9da-4c8c-a21a-8563a6db2f15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.623216 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-26f37602-d9da-4c8c-a21a-8563a6db2f15 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046214 Aug 02 09:16:18.623811 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 542/1074] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:18 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:19.635172 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0aa2ed7e-0b34-4d18-b17e-95b3c569b6fe tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:19.637644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0aa2ed7e-0b34-4d18-b17e-95b3c569b6fe tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:19.643999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0aa2ed7e-0b34-4d18-b17e-95b3c569b6fe tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.644492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0aa2ed7e-0b34-4d18-b17e-95b3c569b6fe tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.645261 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0aa2ed7e-0b34-4d18-b17e-95b3c569b6fe tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.645699 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0aa2ed7e-0b34-4d18-b17e-95b3c569b6fe tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.675245 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0aa2ed7e-0b34-4d18-b17e-95b3c569b6fe tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044532 Aug 02 09:16:19.675813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 533/1075] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:19 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:16:19.741519 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4ed8fd4a-0860-4cbd-9015-c3efe0535b08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:19.742116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4ed8fd4a-0860-4cbd-9015-c3efe0535b08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:19.748525 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd4a-0860-4cbd-9015-c3efe0535b08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.748976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd4a-0860-4cbd-9015-c3efe0535b08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.749741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd4a-0860-4cbd-9015-c3efe0535b08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.750202 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd4a-0860-4cbd-9015-c3efe0535b08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.775834 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4ed8fd4a-0860-4cbd-9015-c3efe0535b08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:16:20.063391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4ed8fd4a-0860-4cbd-9015-c3efe0535b08 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 204 len: 0 microversion: 2.1 time: 0.326161 Aug 02 09:16:20.064594 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 543/1076] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:16:19 2022] DELETE /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:16:20.073643 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bb0e5ddd-41b7-45a6-909e-52a4cf41c74b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:20.075598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bb0e5ddd-41b7-45a6-909e-52a4cf41c74b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:20.085034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bb0e5ddd-41b7-45a6-909e-52a4cf41c74b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.085528 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bb0e5ddd-41b7-45a6-909e-52a4cf41c74b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.086448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bb0e5ddd-41b7-45a6-909e-52a4cf41c74b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.086892 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bb0e5ddd-41b7-45a6-909e-52a4cf41c74b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.108566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-64fe39e7-712e-4a6c-90a9-9666eed52b7f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:20.109190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-64fe39e7-712e-4a6c-90a9-9666eed52b7f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:20.115885 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-64fe39e7-712e-4a6c-90a9-9666eed52b7f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.116339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-64fe39e7-712e-4a6c-90a9-9666eed52b7f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.117126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-64fe39e7-712e-4a6c-90a9-9666eed52b7f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.117571 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-64fe39e7-712e-4a6c-90a9-9666eed52b7f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.142197 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-64fe39e7-712e-4a6c-90a9-9666eed52b7f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lazy-loading 'flavor' on Instance uuid dea1ac8c-8116-4fed-a2e3-230762ade4b1 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:20.224932 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bb0e5ddd-41b7-45a6-909e-52a4cf41c74b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:20.232455 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bb0e5ddd-41b7-45a6-909e-52a4cf41c74b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1679 microversion: 2.1 time: 0.163203 Aug 02 09:16:20.233029 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 534/1077] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:20 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:20.379192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:20.621582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-64fe39e7-712e-4a6c-90a9-9666eed52b7f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/action" status: 202 len: 0 microversion: 2.20 time: 0.517330 Aug 02 09:16:20.622206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 544/1078] 10.222.0.46 () {62 vars in 1319 bytes} [Tue Aug 2 09:16:20 2022] POST /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:16:20.630226 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:20.631424 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:20.637553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.638149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.638798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.639233 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.777448 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:20.785316 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:20.786844 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:20.788016 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-72c31ca8-ab98-493b-a214-b046391140ca tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.161639 Aug 02 09:16:20.788571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 535/1079] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:20 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:21.255443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-657a4fe9-dcc7-424a-bc9d-fd7bab420c73 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:21.256168 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-657a4fe9-dcc7-424a-bc9d-fd7bab420c73 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:21.263220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-657a4fe9-dcc7-424a-bc9d-fd7bab420c73 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.263669 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-657a4fe9-dcc7-424a-bc9d-fd7bab420c73 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.264429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-657a4fe9-dcc7-424a-bc9d-fd7bab420c73 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.264857 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-657a4fe9-dcc7-424a-bc9d-fd7bab420c73 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.393950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-657a4fe9-dcc7-424a-bc9d-fd7bab420c73 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:21.402212 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-657a4fe9-dcc7-424a-bc9d-fd7bab420c73 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1679 microversion: 2.1 time: 0.151969 Aug 02 09:16:21.402783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 545/1080] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:21 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:21.811962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:21.812575 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:21.819905 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.820355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.821139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.821576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.996306 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.004156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.005838 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.007017 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-918b8809-ece0-425c-9d2a-33deefdd01ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.199317 Aug 02 09:16:22.007572 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 536/1081] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:21 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:22.424346 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9e3794cc-4046-46a5-8a48-e20db9fcb6d1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:22.424989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9e3794cc-4046-46a5-8a48-e20db9fcb6d1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:22.427675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:22.433297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e3794cc-4046-46a5-8a48-e20db9fcb6d1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.441016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e3794cc-4046-46a5-8a48-e20db9fcb6d1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.441016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e3794cc-4046-46a5-8a48-e20db9fcb6d1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.441016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e3794cc-4046-46a5-8a48-e20db9fcb6d1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.581075 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9e3794cc-4046-46a5-8a48-e20db9fcb6d1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.589771 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9e3794cc-4046-46a5-8a48-e20db9fcb6d1 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1679 microversion: 2.1 time: 0.169627 Aug 02 09:16:22.590376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 546/1082] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:22 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:23.029473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:23.032092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:23.036817 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.037277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.038160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.038529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.252368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.260480 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.262006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.263177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-daf1719b-3cec-4265-b6e2-2483adfd0741 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.237642 Aug 02 09:16:23.263733 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 537/1083] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:23 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:23.415000 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-09d7d035-c4cb-4c6f-a559-6c5ef857878b req-de6f2d20-a9ee-4ac0-92b5-33c45ca930be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f440de7e-1c06-4efd-aa35-34b3ab64b494", "name": "network-vif-deleted", "tag": "826babce-e872-4dc2-b4f6-87a692125e7b"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:23.425966 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-09d7d035-c4cb-4c6f-a559-6c5ef857878b req-de6f2d20-a9ee-4ac0-92b5-33c45ca930be service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.427684 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-09d7d035-c4cb-4c6f-a559-6c5ef857878b req-de6f2d20-a9ee-4ac0-92b5-33c45ca930be service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.441060 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-09d7d035-c4cb-4c6f-a559-6c5ef857878b req-de6f2d20-a9ee-4ac0-92b5-33c45ca930be service nova] Creating event network-vif-deleted:826babce-e872-4dc2-b4f6-87a692125e7b for instance f440de7e-1c06-4efd-aa35-34b3ab64b494 on hv-cinder-84713 Aug 02 09:16:23.446523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-09d7d035-c4cb-4c6f-a559-6c5ef857878b req-de6f2d20-a9ee-4ac0-92b5-33c45ca930be service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038726 Aug 02 09:16:23.447494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 547/1084] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:23.611576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e496f616-3e84-4bbe-984c-0f36b0099f2e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:23.612194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e496f616-3e84-4bbe-984c-0f36b0099f2e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:23.618317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e496f616-3e84-4bbe-984c-0f36b0099f2e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.618770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e496f616-3e84-4bbe-984c-0f36b0099f2e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.619543 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e496f616-3e84-4bbe-984c-0f36b0099f2e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.619987 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e496f616-3e84-4bbe-984c-0f36b0099f2e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.624217 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:23.686704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e496f616-3e84-4bbe-984c-0f36b0099f2e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.695135 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e496f616-3e84-4bbe-984c-0f36b0099f2e tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 200 len: 1325 microversion: 2.1 time: 0.087549 Aug 02 09:16:23.697651 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 538/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:23 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 1325 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:24.287736 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:24.293174 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:24.294892 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.295346 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.296131 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.296569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.441860 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:24.451004 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:24.452830 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:24.454628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a7124952-0f32-4f02-af15-be5dde2a149b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.171844 Aug 02 09:16:24.455197 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 548/1086] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:24 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:24.717038 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:24.717583 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:24.719839 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:24.725379 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.725827 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.726612 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.727045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.741264 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 HTTP/1.1 Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:16:24.742818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:16:24.744365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'f440de7e-1c06-4efd-aa35-34b3ab64b494'} Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:16:24.745269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:16:24.746872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:16:24.748317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:16:24.748317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1018ef66-c07d-4cd0-b524-53b45096d212 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 404 len: 111 microversion: 2.1 time: 0.031559 Aug 02 09:16:24.748317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 539/1087] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:24 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:16:24.753067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-93cf35c8-0b95-446e-aa1e-783c69b24530 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '.version_select at 0x7f0f2d4d2ee0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:24.839803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-93cf35c8-0b95-446e-aa1e-783c69b24530 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-257507973" status: 202 len: 0 microversion: 2.1 time: 0.090488 Aug 02 09:16:24.840603 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 549/1088] 10.222.0.46 () {58 vars in 1218 bytes} [Tue Aug 2 09:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-257507973 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:16:25.478835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:25.479529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:25.486372 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.486889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.487662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.488100 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.614546 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d5edb960-9020-4a6b-9fa5-926b3dcf357b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: .version_select at 0x7f0f2d61c8b0>, body: {"keypair": {"name": "tempest-keypair-27233177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIngtKOFukN3vXceuNE8zzzKgVTa9nh03xTDGLbkD1ZMbD45Y8i0ZlXGY8e3B6ETXfpKrQLHvNvV5KNH/Q03gHBcXjemzxzGI3e7U/GHO18Rtyd3MakUDgsBOm93XejQbA=="}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:25.632185 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-d5edb960-9020-4a6b-9fa5-926b3dcf357b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for project b9df882a572a4bed8966779e50eb7e7c. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:16:25.636081 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-d5edb960-9020-4a6b-9fa5-926b3dcf357b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for user 806f0c03435e4c5daeadaa4eb437d936 and project b9df882a572a4bed8966779e50eb7e7c. Resources: {'key_pairs'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:16:25.641276 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:25.649738 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:25.651272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:25.652437 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ab86c9f6-bbcf-46fc-b280-277d6e5088ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.178755 Aug 02 09:16:25.652986 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 540/1089] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:25 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:25.746484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d5edb960-9020-4a6b-9fa5-926b3dcf357b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.136342 Aug 02 09:16:25.747107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 550/1090] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:16:25 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:26.675989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:26.677234 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:26.683800 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.684325 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.685354 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.685795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.828795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:26.837460 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:26.839097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:26.840973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d117fa4b-ab73-4715-a341-2216358b26e6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.168092 Aug 02 09:16:26.841789 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 541/1091] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:26 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:27.865835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:27.866539 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:27.873292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.873823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.874569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.874999 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.014646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.022818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.024308 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.025570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3223d0be-d27d-4d92-8569-5bb88a72468a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.164616 Aug 02 09:16:28.026796 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 551/1092] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:27 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:28.044311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1339405575", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "406c2791-4e79-4511-a29d-6d14a120682a"}], "security_groups": [{"name": "tempest-securitygroup--445780374"}], "key_name": "tempest-keypair-27233177", "user_data": "}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:28.144892 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.network.neutron [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] validate_networks() for [('406c2791-4e79-4511-a29d-6d14a120682a', None, None, None, None, None)] {{(pid=118368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:16:28.510004 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Flavor limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:16:28.510430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Image limits 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:16:28.510902 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Flavor pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:16:28.511312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Image pref 0:0:0 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:16:28.511752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.virt.hardware [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:16:28.520790 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.521324 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.522280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.522722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.539874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for project b9df882a572a4bed8966779e50eb7e7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:16:28.543837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Getting quotas for user 806f0c03435e4c5daeadaa4eb437d936 and project b9df882a572a4bed8966779e50eb7e7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:16:28.555392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Going to run 1 instances... {{(pid=118368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:16:28.557677 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:16:28.688683 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ac525a5e-5ce3-4561-9e91-466850fec506 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704306 Aug 02 09:16:28.689319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 542/1093] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:16:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:16:28.700400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a0c46d4b-058c-4940-82fd-7dd859d1ee9b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:28.701146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a0c46d4b-058c-4940-82fd-7dd859d1ee9b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:28.755367 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a0c46d4b-058c-4940-82fd-7dd859d1ee9b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.763101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a0c46d4b-058c-4940-82fd-7dd859d1ee9b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1240 microversion: 2.1 time: 0.066291 Aug 02 09:16:28.764016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 552/1094] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:28 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:29.187974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:29.188631 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:29.196202 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.196667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.197394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.197823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.334228 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.342394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.343977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.345275 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f65bc6de-b8e0-4fa4-b5ac-001fa510e515 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.300325 Aug 02 09:16:29.345832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 543/1095] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:29 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:29.785278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2cb9b3a7-6769-4155-bf1a-24a725da1e65 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:29.785952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2cb9b3a7-6769-4155-bf1a-24a725da1e65 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:29.793406 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2cb9b3a7-6769-4155-bf1a-24a725da1e65 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.793861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2cb9b3a7-6769-4155-bf1a-24a725da1e65 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.794861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2cb9b3a7-6769-4155-bf1a-24a725da1e65 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.795299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2cb9b3a7-6769-4155-bf1a-24a725da1e65 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.861305 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2cb9b3a7-6769-4155-bf1a-24a725da1e65 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.868888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2cb9b3a7-6769-4155-bf1a-24a725da1e65 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1244 microversion: 2.1 time: 0.087516 Aug 02 09:16:29.869498 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 553/1096] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:29 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:30.369605 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:30.370291 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:30.377086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.377660 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.378946 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.379398 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.514971 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.523816 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.525341 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.526539 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-92105f9c-860f-4137-b1ff-157580a8cb87 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.161059 Aug 02 09:16:30.527117 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 544/1097] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:30 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:30.890878 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-dfb83973-b845-48c1-b265-9433c90972ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:30.891714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-dfb83973-b845-48c1-b265-9433c90972ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:30.902869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfb83973-b845-48c1-b265-9433c90972ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.903320 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfb83973-b845-48c1-b265-9433c90972ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.904102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfb83973-b845-48c1-b265-9433c90972ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.904834 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-dfb83973-b845-48c1-b265-9433c90972ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.971869 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-dfb83973-b845-48c1-b265-9433c90972ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.980039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-dfb83973-b845-48c1-b265-9433c90972ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1300 microversion: 2.1 time: 0.093259 Aug 02 09:16:30.980613 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 554/1098] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:30 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:31.549957 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:31.550561 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:31.557175 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.557624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.558495 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.558880 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.787531 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:31.803093 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:31.803093 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:31.803093 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-09e10279-48f3-4dcf-be1d-875cee6c6f28 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.254567 Aug 02 09:16:31.803473 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 545/1099] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:31 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:32.002234 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-13c7bfc3-e3dc-4b66-9bfe-6ba555885118 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:32.002779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-13c7bfc3-e3dc-4b66-9bfe-6ba555885118 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:32.010113 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-13c7bfc3-e3dc-4b66-9bfe-6ba555885118 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.010561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-13c7bfc3-e3dc-4b66-9bfe-6ba555885118 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.011335 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-13c7bfc3-e3dc-4b66-9bfe-6ba555885118 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.011769 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-13c7bfc3-e3dc-4b66-9bfe-6ba555885118 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.147232 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-13c7bfc3-e3dc-4b66-9bfe-6ba555885118 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:32.155018 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-13c7bfc3-e3dc-4b66-9bfe-6ba555885118 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.156675 Aug 02 09:16:32.155603 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 555/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:31 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:32.658643 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-517b7013-affa-4da1-b47b-5ecfe46f738c req-1fc7748a-1f58-42a7-a6db-40dc1719d765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd428921-4950-4abc-9030-0ee67d03584d", "tag": "0cb4b587-e74a-4d56-a4c3-b98862618972"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:32.669869 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-517b7013-affa-4da1-b47b-5ecfe46f738c req-1fc7748a-1f58-42a7-a6db-40dc1719d765 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.670330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-517b7013-affa-4da1-b47b-5ecfe46f738c req-1fc7748a-1f58-42a7-a6db-40dc1719d765 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.682699 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-517b7013-affa-4da1-b47b-5ecfe46f738c req-1fc7748a-1f58-42a7-a6db-40dc1719d765 service nova] Creating event network-changed:0cb4b587-e74a-4d56-a4c3-b98862618972 for instance dd428921-4950-4abc-9030-0ee67d03584d on hv-cinder-84713 Aug 02 09:16:32.688342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-517b7013-affa-4da1-b47b-5ecfe46f738c req-1fc7748a-1f58-42a7-a6db-40dc1719d765 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034603 Aug 02 09:16:32.688944 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 546/1101] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:32.824821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:32.825355 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:32.831713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.832164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.833009 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.833448 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.971597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:32.980394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:32.981932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:32.983105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2af46501-4e06-4313-b6ef-52ea25568bad tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.162342 Aug 02 09:16:32.983671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 556/1102] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:32 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:33.176293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5965bcca-a5b2-49a2-819e-0fbff71d7e6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:33.177521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5965bcca-a5b2-49a2-819e-0fbff71d7e6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:33.184030 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5965bcca-a5b2-49a2-819e-0fbff71d7e6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.184478 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5965bcca-a5b2-49a2-819e-0fbff71d7e6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.185498 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5965bcca-a5b2-49a2-819e-0fbff71d7e6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.185954 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5965bcca-a5b2-49a2-819e-0fbff71d7e6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.352771 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5965bcca-a5b2-49a2-819e-0fbff71d7e6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:33.360235 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5965bcca-a5b2-49a2-819e-0fbff71d7e6d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.188151 Aug 02 09:16:33.360742 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 547/1103] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:33 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:34.007152 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:34.007786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:34.014316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.014770 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.015546 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.015986 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.148297 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:34.156887 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:34.158437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:34.159604 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-23fa7dac-e008-44af-bc15-6e8e434523cc tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.156611 Aug 02 09:16:34.160162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 557/1104] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:34 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:34.390363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9e344240-4a52-425a-8a2d-a7db0814d36a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:34.390363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9e344240-4a52-425a-8a2d-a7db0814d36a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:34.390363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e344240-4a52-425a-8a2d-a7db0814d36a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.390363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e344240-4a52-425a-8a2d-a7db0814d36a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.391240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e344240-4a52-425a-8a2d-a7db0814d36a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.391240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9e344240-4a52-425a-8a2d-a7db0814d36a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.527722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9e344240-4a52-425a-8a2d-a7db0814d36a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:34.535280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9e344240-4a52-425a-8a2d-a7db0814d36a tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.158166 Aug 02 09:16:34.535945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 548/1105] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:34 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:35.183556 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:35.184162 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:35.190991 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.191381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.192148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.192590 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.319605 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.327482 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.336052 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.336052 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ae838d7c-caf5-43b2-ae9e-6259538b3c71 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.150557 Aug 02 09:16:35.336052 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 558/1106] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:35 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:35.557810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fea6cc34-f3d8-4c13-9884-4dbb0ab147ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:35.558916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fea6cc34-f3d8-4c13-9884-4dbb0ab147ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:35.567594 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fea6cc34-f3d8-4c13-9884-4dbb0ab147ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.568240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fea6cc34-f3d8-4c13-9884-4dbb0ab147ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.570618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fea6cc34-f3d8-4c13-9884-4dbb0ab147ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.570618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fea6cc34-f3d8-4c13-9884-4dbb0ab147ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.735195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:16:35.735195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Tue Aug 2 09:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:16:35.735434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fea6cc34-f3d8-4c13-9884-4dbb0ab147ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.744586 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fea6cc34-f3d8-4c13-9884-4dbb0ab147ed tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.191472 Aug 02 09:16:35.745166 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 549/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:35 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:36.358065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:36.358623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:36.366061 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.366515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.367291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.367730 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.500274 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:36.508895 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:36.510455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:36.511593 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9015d4de-8c39-4614-af2f-43aa66f3e3f3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.157557 Aug 02 09:16:36.512155 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 559/1108] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:36 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:36.767938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-09fc6cb9-c7de-4df9-8080-a5e2f4793dcb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:36.768518 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-09fc6cb9-c7de-4df9-8080-a5e2f4793dcb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:36.775210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09fc6cb9-c7de-4df9-8080-a5e2f4793dcb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.775657 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09fc6cb9-c7de-4df9-8080-a5e2f4793dcb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.776538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09fc6cb9-c7de-4df9-8080-a5e2f4793dcb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.776885 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09fc6cb9-c7de-4df9-8080-a5e2f4793dcb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.912658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-09fc6cb9-c7de-4df9-8080-a5e2f4793dcb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:36.920296 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-09fc6cb9-c7de-4df9-8080-a5e2f4793dcb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.156213 Aug 02 09:16:36.920801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 550/1109] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:36 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:37.535065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:37.536063 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:37.542885 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.543340 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.544108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.544543 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.673267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.682393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.683901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.685303 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-da273bb5-14aa-46d8-b70e-9022f6f4bd0b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.154429 Aug 02 09:16:37.685862 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 560/1110] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:37 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:37.943804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f7bf89e5-45b6-4842-89e8-2a5746bccbae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:37.943804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f7bf89e5-45b6-4842-89e8-2a5746bccbae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:37.950146 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f7bf89e5-45b6-4842-89e8-2a5746bccbae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.950608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f7bf89e5-45b6-4842-89e8-2a5746bccbae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.951392 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f7bf89e5-45b6-4842-89e8-2a5746bccbae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.951830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f7bf89e5-45b6-4842-89e8-2a5746bccbae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.087242 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f7bf89e5-45b6-4842-89e8-2a5746bccbae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:38.095049 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f7bf89e5-45b6-4842-89e8-2a5746bccbae tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.157082 Aug 02 09:16:38.095629 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 551/1111] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:37 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:38.709661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:38.710303 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:38.716927 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.717313 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.718114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.718540 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.759788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=6 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:38.853971 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:38.861771 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:38.863295 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:38.864438 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d510b245-8f2f-46ce-8895-4f612f4f8eea tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1742 microversion: 2.20 time: 0.159415 Aug 02 09:16:38.864995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 561/1112] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:38 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:39.116581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-86cb10a6-0b08-4354-9d47-d98dc9f3b434 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:39.117355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-86cb10a6-0b08-4354-9d47-d98dc9f3b434 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:39.119298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:39.119988 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=6 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:39.125272 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-86cb10a6-0b08-4354-9d47-d98dc9f3b434 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.127681 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-86cb10a6-0b08-4354-9d47-d98dc9f3b434 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.127681 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-86cb10a6-0b08-4354-9d47-d98dc9f3b434 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.127681 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-86cb10a6-0b08-4354-9d47-d98dc9f3b434 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.273038 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-86cb10a6-0b08-4354-9d47-d98dc9f3b434 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:39.282908 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-86cb10a6-0b08-4354-9d47-d98dc9f3b434 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.170069 Aug 02 09:16:39.283601 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 552/1113] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:39 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:39.309292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-446cc72b-2ced-45d8-af13-690312789a2d req-502e5fa4-960b-443b-9fbd-bc95ad8d456e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd428921-4950-4abc-9030-0ee67d03584d", "name": "network-vif-plugged", "status": "completed", "tag": "0cb4b587-e74a-4d56-a4c3-b98862618972"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:39.320407 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-446cc72b-2ced-45d8-af13-690312789a2d req-502e5fa4-960b-443b-9fbd-bc95ad8d456e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.320852 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-446cc72b-2ced-45d8-af13-690312789a2d req-502e5fa4-960b-443b-9fbd-bc95ad8d456e service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.335459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-446cc72b-2ced-45d8-af13-690312789a2d req-502e5fa4-960b-443b-9fbd-bc95ad8d456e service nova] Creating event network-vif-plugged:0cb4b587-e74a-4d56-a4c3-b98862618972 for instance dd428921-4950-4abc-9030-0ee67d03584d on hv-cinder-84713 Aug 02 09:16:39.340554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-446cc72b-2ced-45d8-af13-690312789a2d req-502e5fa4-960b-443b-9fbd-bc95ad8d456e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034951 Aug 02 09:16:39.342309 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 562/1114] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:39.888482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:39.888999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:39.895671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.896099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.896853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.897278 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.027552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:40.036179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:40.037689 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:40.038870 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1a66a572-7f1d-4fef-87ce-1916fe840791 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1742 microversion: 2.20 time: 0.154762 Aug 02 09:16:40.039472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 553/1115] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:39 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:40.306384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0cc462a9-de44-43a1-9e57-c13d12d892c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:40.307255 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0cc462a9-de44-43a1-9e57-c13d12d892c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:40.314539 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0cc462a9-de44-43a1-9e57-c13d12d892c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.314942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0cc462a9-de44-43a1-9e57-c13d12d892c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.315943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0cc462a9-de44-43a1-9e57-c13d12d892c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.316153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0cc462a9-de44-43a1-9e57-c13d12d892c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.445287 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0cc462a9-de44-43a1-9e57-c13d12d892c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:40.452749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0cc462a9-de44-43a1-9e57-c13d12d892c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.150631 Aug 02 09:16:40.453311 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 563/1116] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:40 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:41.062405 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:41.063003 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:41.070390 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.070852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.071638 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.072072 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.205555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:41.214160 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:41.218563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:41.218563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c3953a61-1987-4d30-b582-03c4355cec53 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1742 microversion: 2.20 time: 0.158606 Aug 02 09:16:41.218563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 554/1117] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:41 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:41.475048 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6c1fcebe-4506-435c-9bfd-37922fa4f1be tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:41.475596 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6c1fcebe-4506-435c-9bfd-37922fa4f1be tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:41.482531 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c1fcebe-4506-435c-9bfd-37922fa4f1be tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.482983 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c1fcebe-4506-435c-9bfd-37922fa4f1be tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.483809 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c1fcebe-4506-435c-9bfd-37922fa4f1be tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.484193 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c1fcebe-4506-435c-9bfd-37922fa4f1be tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.620213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6c1fcebe-4506-435c-9bfd-37922fa4f1be tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:41.627871 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6c1fcebe-4506-435c-9bfd-37922fa4f1be tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1365 microversion: 2.1 time: 0.158167 Aug 02 09:16:41.628445 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 564/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:41 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:42.241315 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:42.241868 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:42.248405 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.248850 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.249607 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.250080 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.386882 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.394900 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.396395 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.397551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-be6c416e-2f64-49c2-b415-9004bb74f8b5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1742 microversion: 2.20 time: 0.160785 Aug 02 09:16:42.398136 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 555/1119] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:42 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:42.650158 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a0f614a6-fce1-4958-bfd1-7c521ae054c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:42.650722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a0f614a6-fce1-4958-bfd1-7c521ae054c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:42.657296 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a0f614a6-fce1-4958-bfd1-7c521ae054c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.657738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a0f614a6-fce1-4958-bfd1-7c521ae054c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.658521 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a0f614a6-fce1-4958-bfd1-7c521ae054c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.658949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a0f614a6-fce1-4958-bfd1-7c521ae054c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.790118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a0f614a6-fce1-4958-bfd1-7c521ae054c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.793616 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=100 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:42.797995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a0f614a6-fce1-4958-bfd1-7c521ae054c0 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1553 microversion: 2.1 time: 0.152266 Aug 02 09:16:42.798567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 565/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:42 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:42.819321 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5dcbe889-6596-4e24-8e91-766e5ef7bc98 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:42.819799 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5dcbe889-6596-4e24-8e91-766e5ef7bc98 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:42.825864 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dcbe889-6596-4e24-8e91-766e5ef7bc98 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.826331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dcbe889-6596-4e24-8e91-766e5ef7bc98 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.827115 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dcbe889-6596-4e24-8e91-766e5ef7bc98 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.827546 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dcbe889-6596-4e24-8e91-766e5ef7bc98 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.903162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5dcbe889-6596-4e24-8e91-766e5ef7bc98 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087662 Aug 02 09:16:42.903747 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 556/1121] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 2 09:16:42 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:43.261123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-52c0ea8a-720b-4f62-b4d2-aab630111407 req-dbb1428c-e3dd-48bb-8b41-d9d255f24fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea1ac8c-8116-4fed-a2e3-230762ade4b1", "name": "network-vif-plugged", "status": "completed", "tag": "7d6ddb74-8337-4c6b-9b6b-fd59368697e0"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:43.270499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-52c0ea8a-720b-4f62-b4d2-aab630111407 req-dbb1428c-e3dd-48bb-8b41-d9d255f24fa0 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.276491 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-52c0ea8a-720b-4f62-b4d2-aab630111407 req-dbb1428c-e3dd-48bb-8b41-d9d255f24fa0 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.282323 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-52c0ea8a-720b-4f62-b4d2-aab630111407 req-dbb1428c-e3dd-48bb-8b41-d9d255f24fa0 service nova] Creating event network-vif-plugged:7d6ddb74-8337-4c6b-9b6b-fd59368697e0 for instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 on hv-cinder-84713 Aug 02 09:16:43.288086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-52c0ea8a-720b-4f62-b4d2-aab630111407 req-dbb1428c-e3dd-48bb-8b41-d9d255f24fa0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031020 Aug 02 09:16:43.288601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 566/1122] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:43.421019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:43.421608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:43.428348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.428791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.429551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.430013 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.433970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:43.568605 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:43.576938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:43.578508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:43.579698 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-88f1bac2-6c6e-4f6f-b652-2769daf1d746 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1742 microversion: 2.20 time: 0.163057 Aug 02 09:16:43.582348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 557/1123] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:43 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:44.155396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-d61dc00f-8287-4e4a-9f9f-4906dee1c0fe req-32a85f42-b5d7-44b4-9fff-44477bfaf751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd428921-4950-4abc-9030-0ee67d03584d", "tag": "0cb4b587-e74a-4d56-a4c3-b98862618972"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:44.166557 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d61dc00f-8287-4e4a-9f9f-4906dee1c0fe req-32a85f42-b5d7-44b4-9fff-44477bfaf751 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.167086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-d61dc00f-8287-4e4a-9f9f-4906dee1c0fe req-32a85f42-b5d7-44b4-9fff-44477bfaf751 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.178952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-d61dc00f-8287-4e4a-9f9f-4906dee1c0fe req-32a85f42-b5d7-44b4-9fff-44477bfaf751 service nova] Creating event network-changed:0cb4b587-e74a-4d56-a4c3-b98862618972 for instance dd428921-4950-4abc-9030-0ee67d03584d on hv-cinder-84713 Aug 02 09:16:44.183978 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-d61dc00f-8287-4e4a-9f9f-4906dee1c0fe req-32a85f42-b5d7-44b4-9fff-44477bfaf751 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033129 Aug 02 09:16:44.184913 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 567/1124] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:44.603350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:44.603956 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:44.610420 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.610867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.611633 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.612266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.827739 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:44.837070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:44.838768 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:44.839962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b5bb54a7-27ad-41db-846d-ef4b7de4629b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1742 microversion: 2.20 time: 0.240497 Aug 02 09:16:44.840535 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 558/1125] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:44 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1742 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:45.865528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:45.866317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:45.872630 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:45.873089 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:45.873865 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:45.874325 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.022456 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:46.031523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:46.033261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:46.034493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-888c1464-6cd9-4e98-96e8-a77b243318eb tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.174398 Aug 02 09:16:46.035521 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 568/1126] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:45 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:47.059324 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:47.060172 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:47.067792 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:47.068482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:47.069434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:47.070079 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:47.225146 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:47.234296 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:47.237533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:47.238976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-51e44621-d1a6-4da8-8810-48433b48f4a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.183842 Aug 02 09:16:47.239798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 559/1127] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:47 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:48.263776 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:48.264330 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:48.272475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:48.273295 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:48.274993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:48.275745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:48.448498 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:48.456620 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:48.459938 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:48.461460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fe3c3f5d-43ce-461a-89db-3e54148d8868 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.201912 Aug 02 09:16:48.462260 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 569/1128] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:48 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:49.486852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:49.489156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:49.495802 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:49.496312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:49.501122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:49.501122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:49.666648 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:49.678561 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:49.681263 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:49.682585 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-69935c61-54ac-430b-86a3-a9eb67ca827e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.200956 Aug 02 09:16:49.686810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 560/1129] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:49 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:50.709192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:50.711280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:50.718220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:50.719725 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:50.720838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:50.721334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:50.873303 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:50.883523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:50.887118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:50.887118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1be58610-60c2-4b27-a790-ead70f57453e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.181507 Aug 02 09:16:50.887118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 570/1130] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:50 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:16:51.911331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:51.911993 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:51.919610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:51.920062 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:51.920856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:51.921302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:52.073435 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:52.082440 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:52.084432 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:52.085671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-85c093c2-0192-4b3c-95ea-807520a53dc9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.178369 Aug 02 09:16:52.102593 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 561/1131] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:51 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:53.111686 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:53.112245 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:53.115360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:53.120667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:53.121126 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:53.121986 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:53.122613 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:53.307762 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:53.318065 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:53.324844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:53.332907 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ee7c0503-e05f-4e3e-a4fe-970ca6fd7f13 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.218160 Aug 02 09:16:53.333844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 571/1132] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:53 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:54.359394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:54.359929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:54.368187 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.374412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.374412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.374412 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.516544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:54.524835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:54.526434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:54.527636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-50dbe163-080d-4428-b590-80d71eee4e34 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.173468 Aug 02 09:16:54.528571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 562/1133] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:54 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:55.558051 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:55.560097 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:55.569835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:55.609137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:55.609137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:55.609137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:55.715728 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:55.726184 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:55.727919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:55.729372 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-da494b00-b5af-4bee-b69b-583fcc57cc44 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.180622 Aug 02 09:16:55.730085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 572/1134] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:55 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:56.755109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:56.756056 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:56.759441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:56.764414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:56.764870 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:56.765687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:56.766173 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:56.903682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:56.912491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:56.914054 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:56.915235 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ac0a9e63-703b-4ab8-886b-9e11ee0df66f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.164272 Aug 02 09:16:56.915793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 563/1135] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:56 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:57.939651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:57.940250 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:57.947500 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:57.947955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:57.948724 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:57.949178 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.081387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:58.089788 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:58.091355 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:58.092521 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f743a8cc-93e7-4668-a7ea-6dc38c6b66c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1737 microversion: 2.20 time: 0.156847 Aug 02 09:16:58.093085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 573/1136] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:57 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:59.116381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:59.117006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:59.124095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.124542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.125299 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.125729 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.255723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:59.263799 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:59.265355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:59.266539 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f0ba6d0f-abf5-431c-8fb0-1e9a7a1c6fe5 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1719 microversion: 2.20 time: 0.154692 Aug 02 09:16:59.267096 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 564/1137] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:59 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:00.292723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:00.293368 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:00.300413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.300873 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.301632 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.302101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.436098 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:00.444555 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:00.446349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:00.447500 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-50085839-14bc-4a2a-8182-07c2080ae021 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1719 microversion: 2.20 time: 0.158782 Aug 02 09:17:00.448058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 574/1138] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:00 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:01.285650 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-4b69dfb1-3519-44bd-951e-8b8bf464d642 req-13fda856-0470-487f-a2b6-a7ba7c50bd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea1ac8c-8116-4fed-a2e3-230762ade4b1", "name": "network-vif-unplugged", "status": "completed", "tag": "7d6ddb74-8337-4c6b-9b6b-fd59368697e0"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:01.295577 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-4b69dfb1-3519-44bd-951e-8b8bf464d642 req-13fda856-0470-487f-a2b6-a7ba7c50bd13 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.296050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-4b69dfb1-3519-44bd-951e-8b8bf464d642 req-13fda856-0470-487f-a2b6-a7ba7c50bd13 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.307218 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-4b69dfb1-3519-44bd-951e-8b8bf464d642 req-13fda856-0470-487f-a2b6-a7ba7c50bd13 service nova] Creating event network-vif-unplugged:7d6ddb74-8337-4c6b-9b6b-fd59368697e0 for instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 on hv-cinder-84713 Aug 02 09:17:01.312725 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-4b69dfb1-3519-44bd-951e-8b8bf464d642 req-13fda856-0470-487f-a2b6-a7ba7c50bd13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031635 Aug 02 09:17:01.313307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 565/1139] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:01.470812 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:01.473414 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:01.478249 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.478704 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.479470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.479991 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.608703 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:01.616621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:01.618154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:01.619303 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-38d6fe26-dd93-4bd7-916a-55bf7920d1aa tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1662 microversion: 2.20 time: 0.152475 Aug 02 09:17:01.619864 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 575/1140] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:01 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:01.642611 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-82673008-d3c5-4443-bbb5-119e1cd23747 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23148e03-6405-46d8-8da3-1202dcea3041"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:01.645650 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-82673008-d3c5-4443-bbb5-119e1cd23747 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:01.651960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-82673008-d3c5-4443-bbb5-119e1cd23747 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.652415 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-82673008-d3c5-4443-bbb5-119e1cd23747 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.653205 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-82673008-d3c5-4443-bbb5-119e1cd23747 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.653644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-82673008-d3c5-4443-bbb5-119e1cd23747 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.630781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-82673008-d3c5-4443-bbb5-119e1cd23747 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.992430 Aug 02 09:17:02.631433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 566/1141] 10.222.0.46 () {62 vars in 1364 bytes} [Tue Aug 2 09:17:01 2022] POST /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/os-volume_attachments => generated 188 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:02.754086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6361ac04-3d4d-4f11-a453-b49ce8d22926 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:02.754666 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6361ac04-3d4d-4f11-a453-b49ce8d22926 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:02.760950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6361ac04-3d4d-4f11-a453-b49ce8d22926 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:02.761393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6361ac04-3d4d-4f11-a453-b49ce8d22926 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.762182 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6361ac04-3d4d-4f11-a453-b49ce8d22926 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:02.762611 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6361ac04-3d4d-4f11-a453-b49ce8d22926 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.386663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6361ac04-3d4d-4f11-a453-b49ce8d22926 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/os-volume_attachments/23148e03-6405-46d8-8da3-1202dcea3041" status: 202 len: 0 microversion: 2.20 time: 0.636407 Aug 02 09:17:03.387276 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 576/1142] 10.222.0.46 () {60 vars in 1457 bytes} [Tue Aug 2 09:17:02 2022] DELETE /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/os-volume_attachments/23148e03-6405-46d8-8da3-1202dcea3041 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:17:03.447213 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-aceb6b85-eeed-4db3-9647-9e81cd0212a2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:03.447809 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-aceb6b85-eeed-4db3-9647-9e81cd0212a2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:03.455021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aceb6b85-eeed-4db3-9647-9e81cd0212a2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.455472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aceb6b85-eeed-4db3-9647-9e81cd0212a2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.456822 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aceb6b85-eeed-4db3-9647-9e81cd0212a2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.457346 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aceb6b85-eeed-4db3-9647-9e81cd0212a2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.488130 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-aceb6b85-eeed-4db3-9647-9e81cd0212a2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118368) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:17:03.738486 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-aceb6b85-eeed-4db3-9647-9e81cd0212a2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "POST /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/action" status: 202 len: 0 microversion: 2.20 time: 0.294913 Aug 02 09:17:03.739140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 567/1143] 10.222.0.46 () {62 vars in 1319 bytes} [Tue Aug 2 09:17:03 2022] POST /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:17:03.747045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:03.747708 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:03.754343 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.754886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.755600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.756036 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.900449 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:03.908961 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:03.910753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:03.912300 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-94139586-eda9-4e48-b97b-2d332338a5b8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1670 microversion: 2.20 time: 0.168797 Aug 02 09:17:03.912763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 577/1144] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:03 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:04.937326 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:04.937951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:04.944783 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.945238 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.946040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.946474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.080454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:05.088548 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:05.091552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:05.091552 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4512e378-9ef4-411f-b7ef-cabe10d648ec tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1670 microversion: 2.20 time: 0.158614 Aug 02 09:17:05.091939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 568/1145] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:04 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:17:06.117675 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:06.118618 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:06.125854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.126349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.127135 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.127575 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.270255 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:06.278400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:06.279915 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:06.281089 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-07a76f15-b670-412f-be17-5ab8b8a0a418 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.167958 Aug 02 09:17:06.281656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 578/1146] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:06 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:07.313362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:07.318018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:07.331001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:07.332906 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:07.334793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:07.335948 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:07.523519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:07.531728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:07.533408 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:07.535266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8b21e931-6df6-4d4c-b91f-29c0002f73a4 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.231506 Aug 02 09:17:07.535849 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 569/1147] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:07 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:08.563299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:08.563899 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:08.571909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.572354 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.573135 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.573562 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.711467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:08.719923 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:08.722171 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:08.723376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6ed1b65e-3ac9-4822-b102-f7b402e204c8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.164862 Aug 02 09:17:08.724116 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 579/1148] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:08 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:09.746899 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:09.747490 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:09.755354 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.755354 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.756480 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.756923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.900033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:09.903600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:09.908977 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:09.910555 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:09.911730 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b5f4f8c9-1f4c-4ca8-bbc5-d66e017414a3 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.168837 Aug 02 09:17:09.912286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 570/1149] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:09 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:10.131863 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3f9df5a9-0470-4d25-a165-56bed9e84eae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:10.132730 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3f9df5a9-0470-4d25-a165-56bed9e84eae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:10.138638 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3f9df5a9-0470-4d25-a165-56bed9e84eae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.139085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3f9df5a9-0470-4d25-a165-56bed9e84eae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.139861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3f9df5a9-0470-4d25-a165-56bed9e84eae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.140322 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3f9df5a9-0470-4d25-a165-56bed9e84eae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.168659 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3f9df5a9-0470-4d25-a165-56bed9e84eae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:17:10.199140 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:10.510825 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3f9df5a9-0470-4d25-a165-56bed9e84eae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "DELETE /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 204 len: 0 microversion: 2.1 time: 0.382797 Aug 02 09:17:10.511439 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 580/1150] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:17:10 2022] DELETE /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:17:10.520697 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-58fbfe18-141b-41ee-986f-ba4d617792ad tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:10.521377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-58fbfe18-141b-41ee-986f-ba4d617792ad tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:10.528271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-58fbfe18-141b-41ee-986f-ba4d617792ad tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.528797 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-58fbfe18-141b-41ee-986f-ba4d617792ad tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.529636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-58fbfe18-141b-41ee-986f-ba4d617792ad tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.530186 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-58fbfe18-141b-41ee-986f-ba4d617792ad tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.699951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-58fbfe18-141b-41ee-986f-ba4d617792ad tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:10.724068 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-58fbfe18-141b-41ee-986f-ba4d617792ad tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.208029 Aug 02 09:17:10.724668 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 571/1151] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:10 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:10.937005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:10.937714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:10.947087 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.947799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.948854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.949624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.098888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:11.107616 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:11.109124 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:11.110510 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9cc91000-6a6b-4613-af76-9a1dac3c53d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.178062 Aug 02 09:17:11.111078 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 581/1152] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:10 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:11.746659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-39d6fbe9-62b3-455a-a1c5-4be3c9524a76 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:11.747377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-39d6fbe9-62b3-455a-a1c5-4be3c9524a76 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:11.754368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39d6fbe9-62b3-455a-a1c5-4be3c9524a76 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:11.754837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39d6fbe9-62b3-455a-a1c5-4be3c9524a76 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.755599 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39d6fbe9-62b3-455a-a1c5-4be3c9524a76 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:11.756043 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39d6fbe9-62b3-455a-a1c5-4be3c9524a76 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.897848 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-39d6fbe9-62b3-455a-a1c5-4be3c9524a76 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:11.905939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-39d6fbe9-62b3-455a-a1c5-4be3c9524a76 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.162929 Aug 02 09:17:11.906733 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 572/1153] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:11 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:12.136237 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:12.137281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:12.144545 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.144994 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.145774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.146242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.292791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:12.301000 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:12.302865 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:12.304057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ba7110a6-1629-48c6-b4b9-8439df78c710 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.172652 Aug 02 09:17:12.304635 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 582/1154] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:12 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:12.929376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2e8103dd-93d5-4a3c-ac7e-7c83a009de91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:12.930008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2e8103dd-93d5-4a3c-ac7e-7c83a009de91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:12.937237 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e8103dd-93d5-4a3c-ac7e-7c83a009de91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.937812 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e8103dd-93d5-4a3c-ac7e-7c83a009de91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.938681 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e8103dd-93d5-4a3c-ac7e-7c83a009de91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.939119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e8103dd-93d5-4a3c-ac7e-7c83a009de91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.094976 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2e8103dd-93d5-4a3c-ac7e-7c83a009de91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:13.102776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2e8103dd-93d5-4a3c-ac7e-7c83a009de91 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.177157 Aug 02 09:17:13.103362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 573/1155] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:12 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:13.327386 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:13.328096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:13.334827 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.335362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.336167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.336608 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.482565 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:13.492449 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:13.494158 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:13.495331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6793f0f7-8622-4e5b-8cd8-ce19c2b12635 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.171810 Aug 02 09:17:13.496122 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 583/1156] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:13 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:14.124239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8a1df151-ca58-496c-bf99-a8d57cd5df7a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:14.125080 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8a1df151-ca58-496c-bf99-a8d57cd5df7a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:14.132421 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8a1df151-ca58-496c-bf99-a8d57cd5df7a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.132875 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8a1df151-ca58-496c-bf99-a8d57cd5df7a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.133666 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8a1df151-ca58-496c-bf99-a8d57cd5df7a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.134133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8a1df151-ca58-496c-bf99-a8d57cd5df7a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.278978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-8a1df151-ca58-496c-bf99-a8d57cd5df7a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:14.288628 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8a1df151-ca58-496c-bf99-a8d57cd5df7a tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.168148 Aug 02 09:17:14.289215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 574/1157] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:14 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:14.522844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:14.523589 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:14.536074 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.536598 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.537397 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.537829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.691229 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:14.703134 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:14.704713 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:14.706802 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-38e9781d-efd9-4d79-9e4e-4a3b2d76131a tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.190190 Aug 02 09:17:14.707422 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 584/1158] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:14 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:17:15.310832 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9aa8451e-6484-42ba-85b2-32c05a035cca tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:15.311470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9aa8451e-6484-42ba-85b2-32c05a035cca tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:15.319101 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9aa8451e-6484-42ba-85b2-32c05a035cca tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.319703 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9aa8451e-6484-42ba-85b2-32c05a035cca tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.320482 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9aa8451e-6484-42ba-85b2-32c05a035cca tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.321224 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9aa8451e-6484-42ba-85b2-32c05a035cca tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.466985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9aa8451e-6484-42ba-85b2-32c05a035cca tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:15.474966 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9aa8451e-6484-42ba-85b2-32c05a035cca tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.168157 Aug 02 09:17:15.475777 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 575/1159] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:15 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:15.734396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:15.735135 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:15.747896 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.748781 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.749154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.749591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.894965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:15.904711 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:15.906290 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:15.907474 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1d958cb9-efcd-483f-a832-90909cc96bbe tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.179533 Aug 02 09:17:15.921174 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 585/1160] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:15 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:16.496581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e4869030-f5c9-48a4-be93-a2190b0878ae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:16.497252 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e4869030-f5c9-48a4-be93-a2190b0878ae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:16.504340 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4869030-f5c9-48a4-be93-a2190b0878ae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.504786 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4869030-f5c9-48a4-be93-a2190b0878ae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.505544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4869030-f5c9-48a4-be93-a2190b0878ae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.506014 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e4869030-f5c9-48a4-be93-a2190b0878ae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.644719 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e4869030-f5c9-48a4-be93-a2190b0878ae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:16.652557 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e4869030-f5c9-48a4-be93-a2190b0878ae tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.159793 Aug 02 09:17:16.653145 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 576/1161] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:16 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:16.932718 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:16.933334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:16.945067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.945067 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.945632 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.946099 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.091566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:17.100317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:17.102159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:17.103528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-eaf2a43c-14ef-4864-9b14-b1f798354c47 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.174863 Aug 02 09:17:17.118772 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 586/1162] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:16 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:17.675067 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-01af1285-b649-48d3-b962-4b47345834dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:17.675673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-01af1285-b649-48d3-b962-4b47345834dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:17.682854 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-01af1285-b649-48d3-b962-4b47345834dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.683388 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-01af1285-b649-48d3-b962-4b47345834dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.684408 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-01af1285-b649-48d3-b962-4b47345834dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.684840 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-01af1285-b649-48d3-b962-4b47345834dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.819009 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-01af1285-b649-48d3-b962-4b47345834dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:17.826639 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-01af1285-b649-48d3-b962-4b47345834dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.155968 Aug 02 09:17:17.827396 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 577/1163] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:17 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:18.129668 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:18.130366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:18.136702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.137153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.137953 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.138393 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.268990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:18.278847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:18.280305 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:18.281446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2f96b6d0-0c19-4251-9ed9-c295975e8698 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.156293 Aug 02 09:17:18.282020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 587/1164] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:18 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:18.847576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bc5801bb-5cf6-4ac3-9a34-28fd844333c9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:18.848192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bc5801bb-5cf6-4ac3-9a34-28fd844333c9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:18.855093 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc5801bb-5cf6-4ac3-9a34-28fd844333c9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.855549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc5801bb-5cf6-4ac3-9a34-28fd844333c9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.856348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc5801bb-5cf6-4ac3-9a34-28fd844333c9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.856783 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bc5801bb-5cf6-4ac3-9a34-28fd844333c9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.992232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bc5801bb-5cf6-4ac3-9a34-28fd844333c9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:18.999860 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bc5801bb-5cf6-4ac3-9a34-28fd844333c9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.156708 Aug 02 09:17:19.006588 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 578/1165] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:18 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:19.304944 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:19.305553 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:19.312381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.312836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.313607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.314090 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.450301 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:19.458655 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:19.460159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:19.461301 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a7af7b22-137c-4937-889f-9265e2166bce tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.160281 Aug 02 09:17:19.461855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 588/1166] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:19 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:20.021648 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ffeb006e-fb0e-4ac0-a7b5-ee9372ad30ee tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:20.022297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ffeb006e-fb0e-4ac0-a7b5-ee9372ad30ee tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:20.030158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffeb006e-fb0e-4ac0-a7b5-ee9372ad30ee tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.030600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffeb006e-fb0e-4ac0-a7b5-ee9372ad30ee tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.031363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffeb006e-fb0e-4ac0-a7b5-ee9372ad30ee tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.031791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffeb006e-fb0e-4ac0-a7b5-ee9372ad30ee tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.162161 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ffeb006e-fb0e-4ac0-a7b5-ee9372ad30ee tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:20.169733 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ffeb006e-fb0e-4ac0-a7b5-ee9372ad30ee tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.151933 Aug 02 09:17:20.170341 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 579/1167] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:20 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:20.484706 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:20.485315 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:20.491929 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.492379 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.493137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.493568 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.626369 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:20.634874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:20.636382 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:20.637845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5ba5a683-555f-446c-ba41-f53c4ec7ad92 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.157033 Aug 02 09:17:20.638434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 589/1168] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:20 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:21.191776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-14f9f079-e29a-459a-bc0e-7f8bf4b579dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:21.192336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-14f9f079-e29a-459a-bc0e-7f8bf4b579dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:21.198824 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14f9f079-e29a-459a-bc0e-7f8bf4b579dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.199268 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14f9f079-e29a-459a-bc0e-7f8bf4b579dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.200021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14f9f079-e29a-459a-bc0e-7f8bf4b579dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.200446 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14f9f079-e29a-459a-bc0e-7f8bf4b579dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.329253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-14f9f079-e29a-459a-bc0e-7f8bf4b579dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:21.336985 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-14f9f079-e29a-459a-bc0e-7f8bf4b579dd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.149695 Aug 02 09:17:21.338304 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 580/1169] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:21 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:21.662207 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:21.662814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:21.669331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.669776 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.670567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.671033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.804838 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:21.813005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:21.814564 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:21.815717 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f2dc3231-00ce-485d-9f87-9ca762b2e529 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.157984 Aug 02 09:17:21.816282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 590/1170] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:21 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:22.358433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-39d784b2-e398-42af-a377-e8f8cf50923e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:22.358965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-39d784b2-e398-42af-a377-e8f8cf50923e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:22.365602 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39d784b2-e398-42af-a377-e8f8cf50923e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.366081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39d784b2-e398-42af-a377-e8f8cf50923e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.366845 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39d784b2-e398-42af-a377-e8f8cf50923e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.367279 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-39d784b2-e398-42af-a377-e8f8cf50923e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.504400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-39d784b2-e398-42af-a377-e8f8cf50923e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:22.511949 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-39d784b2-e398-42af-a377-e8f8cf50923e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.157553 Aug 02 09:17:22.512540 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 581/1171] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:22 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:22.838545 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:22.839772 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:22.845968 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.846425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.847190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.847619 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.977103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:22.985188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:22.987279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:22.988429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3ba03010-56ab-4c2f-b7b7-d6d6f3a704e0 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.153836 Aug 02 09:17:22.988995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 591/1172] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:22 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:17:23.533432 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-af656e6a-f47b-4bff-af89-9ccdd084cd88 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:23.534737 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-af656e6a-f47b-4bff-af89-9ccdd084cd88 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:23.540974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-af656e6a-f47b-4bff-af89-9ccdd084cd88 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.541430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-af656e6a-f47b-4bff-af89-9ccdd084cd88 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.542232 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-af656e6a-f47b-4bff-af89-9ccdd084cd88 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.542671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-af656e6a-f47b-4bff-af89-9ccdd084cd88 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.676140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-af656e6a-f47b-4bff-af89-9ccdd084cd88 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:23.683924 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-af656e6a-f47b-4bff-af89-9ccdd084cd88 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.154898 Aug 02 09:17:23.684503 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 582/1173] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:23 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:24.012371 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:24.013212 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:24.015777 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:24.021100 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.021549 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.022352 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.022814 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.162433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:24.172815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:24.175495 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:24.177049 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6d252f7f-2a5b-4c66-a7f0-f0a7e02f6c83 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.168551 Aug 02 09:17:24.187111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 592/1174] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:24 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:24.704516 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3ad48f54-8f90-4421-b10f-f2b10192f97b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:24.705746 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3ad48f54-8f90-4421-b10f-f2b10192f97b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:24.712358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3ad48f54-8f90-4421-b10f-f2b10192f97b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.712801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3ad48f54-8f90-4421-b10f-f2b10192f97b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.713567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3ad48f54-8f90-4421-b10f-f2b10192f97b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.714091 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3ad48f54-8f90-4421-b10f-f2b10192f97b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.996273 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3ad48f54-8f90-4421-b10f-f2b10192f97b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:25.004390 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3ad48f54-8f90-4421-b10f-f2b10192f97b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1577 microversion: 2.1 time: 0.303689 Aug 02 09:17:25.008491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 583/1175] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:24 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1577 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:25.201037 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:25.201653 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:25.208184 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.208635 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.209475 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.209930 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.354956 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:25.365075 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:25.367174 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:25.368609 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8bd25bd6-4aab-4a69-a282-68c844429737 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.171779 Aug 02 09:17:25.369545 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 593/1176] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:25 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:25.472052 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-5d73ad39-80c2-483d-8fc0-bc9c6acc16ab req-11e0a1c3-38b6-42bf-a411-d8bc19046248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea1ac8c-8116-4fed-a2e3-230762ade4b1", "name": "network-vif-plugged", "status": "completed", "tag": "7d6ddb74-8337-4c6b-9b6b-fd59368697e0"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:25.482673 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-5d73ad39-80c2-483d-8fc0-bc9c6acc16ab req-11e0a1c3-38b6-42bf-a411-d8bc19046248 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.483112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-5d73ad39-80c2-483d-8fc0-bc9c6acc16ab req-11e0a1c3-38b6-42bf-a411-d8bc19046248 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.495332 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-5d73ad39-80c2-483d-8fc0-bc9c6acc16ab req-11e0a1c3-38b6-42bf-a411-d8bc19046248 service nova] Creating event network-vif-plugged:7d6ddb74-8337-4c6b-9b6b-fd59368697e0 for instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 on hv-cinder-84713 Aug 02 09:17:25.500535 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-5d73ad39-80c2-483d-8fc0-bc9c6acc16ab req-11e0a1c3-38b6-42bf-a411-d8bc19046248 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032912 Aug 02 09:17:25.501141 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 584/1177] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:26.028282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-95671a0f-b687-4364-ba5f-239a79565450 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:26.028893 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-95671a0f-b687-4364-ba5f-239a79565450 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:26.035745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95671a0f-b687-4364-ba5f-239a79565450 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.036199 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95671a0f-b687-4364-ba5f-239a79565450 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.036980 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95671a0f-b687-4364-ba5f-239a79565450 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.037419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-95671a0f-b687-4364-ba5f-239a79565450 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.101744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-95671a0f-b687-4364-ba5f-239a79565450 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:26.109950 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-95671a0f-b687-4364-ba5f-239a79565450 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1509 microversion: 2.1 time: 0.085487 Aug 02 09:17:26.115744 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 594/1178] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:26 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1509 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:26.278449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-392bb770-d23c-4d84-8225-384b33505f9b req-ed16c09f-a0bd-4be0-abce-45655bf5907a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370371b8-72c0-4cc6-941c-6a5f6b6c1259", "name": "network-vif-deleted", "tag": "c12d0248-16ec-43cf-ad14-77f5781cc7d2"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:26.290999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-392bb770-d23c-4d84-8225-384b33505f9b req-ed16c09f-a0bd-4be0-abce-45655bf5907a service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.291533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-392bb770-d23c-4d84-8225-384b33505f9b req-ed16c09f-a0bd-4be0-abce-45655bf5907a service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.310595 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-392bb770-d23c-4d84-8225-384b33505f9b req-ed16c09f-a0bd-4be0-abce-45655bf5907a service nova] Creating event network-vif-deleted:c12d0248-16ec-43cf-ad14-77f5781cc7d2 for instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 on hv-cinder-84713 Aug 02 09:17:26.318533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-392bb770-d23c-4d84-8225-384b33505f9b req-ed16c09f-a0bd-4be0-abce-45655bf5907a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044565 Aug 02 09:17:26.322701 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 585/1179] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:26.393329 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:26.394643 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:26.401924 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.405786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.405786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.405786 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.546532 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:26.555318 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:26.556831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:26.558031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c1c26b97-a045-4add-9d76-7d3984c869ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.169296 Aug 02 09:17:26.558594 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 595/1180] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:26 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:27.132650 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-375d0ead-4b2e-41cb-88d9-69e41036fc53 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:27.133346 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-375d0ead-4b2e-41cb-88d9-69e41036fc53 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:27.139763 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-375d0ead-4b2e-41cb-88d9-69e41036fc53 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.140213 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-375d0ead-4b2e-41cb-88d9-69e41036fc53 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.140998 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-375d0ead-4b2e-41cb-88d9-69e41036fc53 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.141432 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-375d0ead-4b2e-41cb-88d9-69e41036fc53 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.206433 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-375d0ead-4b2e-41cb-88d9-69e41036fc53 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:27.214068 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-375d0ead-4b2e-41cb-88d9-69e41036fc53 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1225 microversion: 2.1 time: 0.085597 Aug 02 09:17:27.214634 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 586/1181] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:27 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:27.580667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:27.581197 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:27.588040 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.588491 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.589259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.589693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.607007 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:27.724845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:27.732597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:27.734124 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:27.735281 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5add8a03-550a-45c9-af4b-615acff7b89c tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.158658 Aug 02 09:17:27.736439 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 596/1182] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:27 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:28.234895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:28.235963 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:28.242627 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.243080 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.243855 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.244293 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.275620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.276065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.276510 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lazy-loading 'fault' on Instance uuid 370371b8-72c0-4cc6-941c-6a5f6b6c1259 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:17:28.321704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:28.331861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-aafa9779-ec05-4999-96cc-5ae20e49e6a7 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 200 len: 1230 microversion: 2.1 time: 0.100764 Aug 02 09:17:28.336554 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 587/1183] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:28 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:28.759220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:28.759831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:28.766805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.771817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.771817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.771817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.903590 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:28.910963 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:28.912481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:28.913667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-bed058df-1063-4771-b9d1-df4abe3a197b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1728 microversion: 2.20 time: 0.158923 Aug 02 09:17:28.914267 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 597/1184] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:28 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:29.352878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:29.353453 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:29.355934 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:29.361465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.361994 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.362729 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.363176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.377010 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] HTTP exception thrown: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Request method failure captured: Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 HTTP/1.1 Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OrDjZshGh3TStgxhZdrccntPxl6wsUfoo_lBLA9F02EyYjtV7IbB5ccRp82LoIKBJ3uFtzmoB3wWHafwLDPRdQN-yGg4nmW9hE7u23GBoQdx-9H9NN1M3Ca1pXJp5eq7zqEOoqnJLKVpdfB3HDFax8s6zrFd_xrCLLS8XQNHkLZDys Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:17:29.378690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d65888d17d2e439592600a4e9305eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-TestVolumeBootPattern-796762873 Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 02569c995a6d4b678933599f60ad3909 Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:17:29.380348 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '370371b8-72c0-4cc6-941c-6a5f6b6c1259'} Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:17:29.381342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:17:29.382922 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:17:29.384327 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Returning 404 to user: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:17:29.384327 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bdd5da7d-6502-46c7-b113-0ac308ebc3a2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 404 len: 111 microversion: 2.1 time: 0.031266 Aug 02 09:17:29.384811 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 588/1185] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:29 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:17:29.481139 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1047079201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-950545340", "security_groups": [{"name": "tempest-secgroup-smoke-1305715777"}], "block_device_mapping_v2": [{"uuid": "c4e329ec-9f5c-47ce-8524-06432371b7b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "341e5912-5743-40e5-8ad1-cb9e084387ea"}]}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:29.596227 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] validate_networks() for [('341e5912-5743-40e5-8ad1-cb9e084387ea', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:17:29.939280 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:29.939904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:29.946572 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.952992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.952992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.952992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.952992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:29.986709 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:17:29.987211 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:17:29.987580 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:17:29.987985 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:17:29.988387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:17:29.997390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.997835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.998664 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.999131 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:30.016434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Getting quotas for project d65888d17d2e439592600a4e9305eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:17:30.020651 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Getting quotas for user 02569c995a6d4b678933599f60ad3909 and project d65888d17d2e439592600a4e9305eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:17:30.078590 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:17:30.081209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4e329ec-9f5c-47ce-8524-06432371b7b7',volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:17:30.084987 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:30.093737 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:30.095503 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:30.096804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-93123c7c-0f44-4a2a-8c99-426b596dcce8 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1715 microversion: 2.20 time: 0.161614 Aug 02 09:17:30.097426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 589/1186] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:29 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:17:30.451299 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-44a5c339-66d7-4c9f-86d4-fccf527d160f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.973999 Aug 02 09:17:30.452111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 598/1187] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:17:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:17:30.463197 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-38e92975-74ca-4019-9aa1-da9548bf1b2f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:30.463789 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-38e92975-74ca-4019-9aa1-da9548bf1b2f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:30.517207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-38e92975-74ca-4019-9aa1-da9548bf1b2f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:30.523990 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-38e92975-74ca-4019-9aa1-da9548bf1b2f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1094 microversion: 2.1 time: 0.064568 Aug 02 09:17:30.524583 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 590/1188] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:30 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:31.544548 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3de279f5-7326-4303-b2ba-e650550e583e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:31.545160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3de279f5-7326-4303-b2ba-e650550e583e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:31.552910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3de279f5-7326-4303-b2ba-e650550e583e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:31.553366 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3de279f5-7326-4303-b2ba-e650550e583e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:31.554156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3de279f5-7326-4303-b2ba-e650550e583e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:31.554587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3de279f5-7326-4303-b2ba-e650550e583e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:31.615363 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3de279f5-7326-4303-b2ba-e650550e583e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:31.622953 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3de279f5-7326-4303-b2ba-e650550e583e tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1136 microversion: 2.1 time: 0.082363 Aug 02 09:17:31.623602 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 599/1189] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:31 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:32.645060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-9d454b63-0e2b-4d63-b73c-958b50c27ea2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:32.645578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-9d454b63-0e2b-4d63-b73c-958b50c27ea2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:32.651783 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d454b63-0e2b-4d63-b73c-958b50c27ea2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:32.652155 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d454b63-0e2b-4d63-b73c-958b50c27ea2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:32.652916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d454b63-0e2b-4d63-b73c-958b50c27ea2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:32.653370 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-9d454b63-0e2b-4d63-b73c-958b50c27ea2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:32.726782 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-9d454b63-0e2b-4d63-b73c-958b50c27ea2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:32.734341 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-9d454b63-0e2b-4d63-b73c-958b50c27ea2 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1210 microversion: 2.1 time: 0.094051 Aug 02 09:17:32.734904 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 591/1190] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:32 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:33.755649 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-df736928-01e1-4833-9bab-3ad838d8c574 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:33.756426 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-df736928-01e1-4833-9bab-3ad838d8c574 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:33.763165 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-df736928-01e1-4833-9bab-3ad838d8c574 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.763548 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-df736928-01e1-4833-9bab-3ad838d8c574 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.764317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-df736928-01e1-4833-9bab-3ad838d8c574 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.764748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-df736928-01e1-4833-9bab-3ad838d8c574 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.902669 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-df736928-01e1-4833-9bab-3ad838d8c574 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:33.911019 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-df736928-01e1-4833-9bab-3ad838d8c574 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1278 microversion: 2.1 time: 0.159429 Aug 02 09:17:33.911595 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 600/1191] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:33 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:34.063375 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-b58c8979-e35f-4014-a673-58984dd60a0f req-4461023b-6ae2-4204-ba0d-597066bd0129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84201b1d-a6e9-4de9-a793-9c6066555bfe", "tag": "f6ec0826-e49f-499a-a8e4-e5a74769a605"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:34.075181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-b58c8979-e35f-4014-a673-58984dd60a0f req-4461023b-6ae2-4204-ba0d-597066bd0129 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.075611 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-b58c8979-e35f-4014-a673-58984dd60a0f req-4461023b-6ae2-4204-ba0d-597066bd0129 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:34.088210 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-b58c8979-e35f-4014-a673-58984dd60a0f req-4461023b-6ae2-4204-ba0d-597066bd0129 service nova] Creating event network-changed:f6ec0826-e49f-499a-a8e4-e5a74769a605 for instance 84201b1d-a6e9-4de9-a793-9c6066555bfe on hv-cinder-84713 Aug 02 09:17:34.093563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-b58c8979-e35f-4014-a673-58984dd60a0f req-4461023b-6ae2-4204-ba0d-597066bd0129 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 Aug 02 09:17:34.094266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 592/1192] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:34.932706 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e23e67f8-2974-4207-a61c-e52bd73ee875 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:34.933665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e23e67f8-2974-4207-a61c-e52bd73ee875 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:34.941268 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e23e67f8-2974-4207-a61c-e52bd73ee875 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.941715 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e23e67f8-2974-4207-a61c-e52bd73ee875 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:34.942509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e23e67f8-2974-4207-a61c-e52bd73ee875 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.942941 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e23e67f8-2974-4207-a61c-e52bd73ee875 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.080011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e23e67f8-2974-4207-a61c-e52bd73ee875 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:35.087685 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e23e67f8-2974-4207-a61c-e52bd73ee875 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.158903 Aug 02 09:17:35.088255 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 601/1193] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:34 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:36.111118 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0445f807-456f-4760-a72d-3007483cb2f6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:36.111723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0445f807-456f-4760-a72d-3007483cb2f6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:36.118087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0445f807-456f-4760-a72d-3007483cb2f6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.118541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0445f807-456f-4760-a72d-3007483cb2f6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.119307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0445f807-456f-4760-a72d-3007483cb2f6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.119766 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0445f807-456f-4760-a72d-3007483cb2f6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.255355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0445f807-456f-4760-a72d-3007483cb2f6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:36.262975 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0445f807-456f-4760-a72d-3007483cb2f6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.157245 Aug 02 09:17:36.263550 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 593/1194] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:36 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:36.542923 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-26a3f871-28d6-414a-b38f-27206e320ef4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:36.543501 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-26a3f871-28d6-414a-b38f-27206e320ef4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:36.550612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26a3f871-28d6-414a-b38f-27206e320ef4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.551062 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26a3f871-28d6-414a-b38f-27206e320ef4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.552198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26a3f871-28d6-414a-b38f-27206e320ef4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.552636 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-26a3f871-28d6-414a-b38f-27206e320ef4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.576093 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-26a3f871-28d6-414a-b38f-27206e320ef4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/ips" status: 200 len: 145 microversion: 2.1 time: 0.036958 Aug 02 09:17:36.576714 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 602/1195] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:17:36 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:37.284120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1db42e07-ba15-4040-87dc-9db1fb4692bd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:37.284751 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1db42e07-ba15-4040-87dc-9db1fb4692bd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:37.291615 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1db42e07-ba15-4040-87dc-9db1fb4692bd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:37.292065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1db42e07-ba15-4040-87dc-9db1fb4692bd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:37.292841 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1db42e07-ba15-4040-87dc-9db1fb4692bd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:37.293273 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1db42e07-ba15-4040-87dc-9db1fb4692bd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:37.452394 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1db42e07-ba15-4040-87dc-9db1fb4692bd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:37.460652 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1db42e07-ba15-4040-87dc-9db1fb4692bd tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.180933 Aug 02 09:17:37.461255 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 594/1196] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:37 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:38.481574 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3948ca1c-777e-4565-844f-8f55a905b4b9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:38.482208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3948ca1c-777e-4565-844f-8f55a905b4b9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:38.488775 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3948ca1c-777e-4565-844f-8f55a905b4b9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.489223 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3948ca1c-777e-4565-844f-8f55a905b4b9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.490016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3948ca1c-777e-4565-844f-8f55a905b4b9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.490455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3948ca1c-777e-4565-844f-8f55a905b4b9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.631995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-3948ca1c-777e-4565-844f-8f55a905b4b9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:38.640111 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3948ca1c-777e-4565-844f-8f55a905b4b9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.162131 Aug 02 09:17:38.640687 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 603/1197] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:38 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:39.663346 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7982b265-20a6-4fbc-a38c-65c1069ad269 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:39.663996 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7982b265-20a6-4fbc-a38c-65c1069ad269 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:39.670531 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7982b265-20a6-4fbc-a38c-65c1069ad269 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.670975 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7982b265-20a6-4fbc-a38c-65c1069ad269 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.671737 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7982b265-20a6-4fbc-a38c-65c1069ad269 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.672161 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7982b265-20a6-4fbc-a38c-65c1069ad269 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.808658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7982b265-20a6-4fbc-a38c-65c1069ad269 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:39.816651 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7982b265-20a6-4fbc-a38c-65c1069ad269 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.157134 Aug 02 09:17:39.817239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 595/1198] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:39 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:39.926785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4e4b73c4-dfd5-4f06-994d-82a73a460175 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a11ca15-0294-4e58-ba2c-aa9f59ed4ba5"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:39.929168 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4e4b73c4-dfd5-4f06-994d-82a73a460175 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:39.935562 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4e4b73c4-dfd5-4f06-994d-82a73a460175 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.936011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4e4b73c4-dfd5-4f06-994d-82a73a460175 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.936784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4e4b73c4-dfd5-4f06-994d-82a73a460175 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.937207 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4e4b73c4-dfd5-4f06-994d-82a73a460175 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.008522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:40.027085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=6 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:40.613015 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4e4b73c4-dfd5-4f06-994d-82a73a460175 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690529 Aug 02 09:17:40.613632 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 604/1199] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:17:39 2022] POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:40.836662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7e02b4cf-69a3-4399-a923-24483bacebd9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:40.837400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7e02b4cf-69a3-4399-a923-24483bacebd9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:40.839413 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=2 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:40.844970 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e02b4cf-69a3-4399-a923-24483bacebd9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:40.845368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e02b4cf-69a3-4399-a923-24483bacebd9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.846479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e02b4cf-69a3-4399-a923-24483bacebd9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:40.846913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e02b4cf-69a3-4399-a923-24483bacebd9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.983282 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7e02b4cf-69a3-4399-a923-24483bacebd9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:40.991344 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7e02b4cf-69a3-4399-a923-24483bacebd9 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.158472 Aug 02 09:17:40.992099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 596/1200] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:40 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:42.013339 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a76c6597-ec45-49f0-b771-4cc13fd40c18 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:42.014071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a76c6597-ec45-49f0-b771-4cc13fd40c18 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:42.020962 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a76c6597-ec45-49f0-b771-4cc13fd40c18 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.021420 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a76c6597-ec45-49f0-b771-4cc13fd40c18 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.022222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a76c6597-ec45-49f0-b771-4cc13fd40c18 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.022663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a76c6597-ec45-49f0-b771-4cc13fd40c18 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.158123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a76c6597-ec45-49f0-b771-4cc13fd40c18 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:42.165586 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a76c6597-ec45-49f0-b771-4cc13fd40c18 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.156563 Aug 02 09:17:42.166196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 605/1201] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:42 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:43.187371 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3d4e1ee8-abd2-4b16-bda3-e160d9d677a4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:43.188576 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3d4e1ee8-abd2-4b16-bda3-e160d9d677a4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:43.195275 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d4e1ee8-abd2-4b16-bda3-e160d9d677a4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.195734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d4e1ee8-abd2-4b16-bda3-e160d9d677a4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.196506 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d4e1ee8-abd2-4b16-bda3-e160d9d677a4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.196941 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d4e1ee8-abd2-4b16-bda3-e160d9d677a4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.332260 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3d4e1ee8-abd2-4b16-bda3-e160d9d677a4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:43.340226 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3d4e1ee8-abd2-4b16-bda3-e160d9d677a4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.156969 Aug 02 09:17:43.340795 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 597/1202] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:43 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:44.361229 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1288f5c7-b253-4c53-8c15-30e8a9d72aa4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:44.361830 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1288f5c7-b253-4c53-8c15-30e8a9d72aa4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:44.368364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1288f5c7-b253-4c53-8c15-30e8a9d72aa4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.368812 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1288f5c7-b253-4c53-8c15-30e8a9d72aa4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.369574 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1288f5c7-b253-4c53-8c15-30e8a9d72aa4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.370026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1288f5c7-b253-4c53-8c15-30e8a9d72aa4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.500083 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1288f5c7-b253-4c53-8c15-30e8a9d72aa4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:44.507516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1288f5c7-b253-4c53-8c15-30e8a9d72aa4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.150778 Aug 02 09:17:44.508078 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 606/1203] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:44 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:45.528654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ce7721cb-095f-40b8-a6cf-c46e675349ea tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:45.530446 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ce7721cb-095f-40b8-a6cf-c46e675349ea tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:45.536550 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ce7721cb-095f-40b8-a6cf-c46e675349ea tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.536989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ce7721cb-095f-40b8-a6cf-c46e675349ea tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.537833 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ce7721cb-095f-40b8-a6cf-c46e675349ea tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.538286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ce7721cb-095f-40b8-a6cf-c46e675349ea tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.685971 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-1c4b15b2-6a7f-4782-bfc3-7fb62dd2b08a req-31c65fb3-6aae-4e5b-a6ef-e97f43373093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84201b1d-a6e9-4de9-a793-9c6066555bfe", "name": "network-vif-plugged", "status": "completed", "tag": "f6ec0826-e49f-499a-a8e4-e5a74769a605"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:45.689656 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ce7721cb-095f-40b8-a6cf-c46e675349ea tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:45.697208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ce7721cb-095f-40b8-a6cf-c46e675349ea tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.172500 Aug 02 09:17:45.697541 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-1c4b15b2-6a7f-4782-bfc3-7fb62dd2b08a req-31c65fb3-6aae-4e5b-a6ef-e97f43373093 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.697784 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 598/1204] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:45 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:45.698005 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-1c4b15b2-6a7f-4782-bfc3-7fb62dd2b08a req-31c65fb3-6aae-4e5b-a6ef-e97f43373093 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.711189 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-1c4b15b2-6a7f-4782-bfc3-7fb62dd2b08a req-31c65fb3-6aae-4e5b-a6ef-e97f43373093 service nova] Creating event network-vif-plugged:f6ec0826-e49f-499a-a8e4-e5a74769a605 for instance 84201b1d-a6e9-4de9-a793-9c6066555bfe on hv-cinder-84713 Aug 02 09:17:45.716906 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-1c4b15b2-6a7f-4782-bfc3-7fb62dd2b08a req-31c65fb3-6aae-4e5b-a6ef-e97f43373093 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093798 Aug 02 09:17:45.717932 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 607/1205] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:46.718575 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7e1a8973-71d1-493e-876e-ab6b2c96a541 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:46.719258 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7e1a8973-71d1-493e-876e-ab6b2c96a541 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:46.725841 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e1a8973-71d1-493e-876e-ab6b2c96a541 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.735373 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e1a8973-71d1-493e-876e-ab6b2c96a541 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.735373 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e1a8973-71d1-493e-876e-ab6b2c96a541 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.735373 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7e1a8973-71d1-493e-876e-ab6b2c96a541 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.918529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7e1a8973-71d1-493e-876e-ab6b2c96a541 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:46.926765 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7e1a8973-71d1-493e-876e-ab6b2c96a541 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1266 microversion: 2.1 time: 0.212045 Aug 02 09:17:46.927350 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 599/1206] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:46 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:47.956041 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0c7025ee-1c96-4faa-8a55-237690cf3765 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:47.956754 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0c7025ee-1c96-4faa-8a55-237690cf3765 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:47.963578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c7025ee-1c96-4faa-8a55-237690cf3765 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.964028 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c7025ee-1c96-4faa-8a55-237690cf3765 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.964798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c7025ee-1c96-4faa-8a55-237690cf3765 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.965232 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c7025ee-1c96-4faa-8a55-237690cf3765 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.099988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0c7025ee-1c96-4faa-8a55-237690cf3765 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:48.107658 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0c7025ee-1c96-4faa-8a55-237690cf3765 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1454 microversion: 2.1 time: 0.156791 Aug 02 09:17:48.108220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 608/1207] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:47 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:48.128259 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ffc882ac-bd36-4128-89e0-7accb7144bba tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:48.128876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ffc882ac-bd36-4128-89e0-7accb7144bba tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:48.135436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffc882ac-bd36-4128-89e0-7accb7144bba tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.135890 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffc882ac-bd36-4128-89e0-7accb7144bba tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.136659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffc882ac-bd36-4128-89e0-7accb7144bba tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.137099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ffc882ac-bd36-4128-89e0-7accb7144bba tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.276228 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ffc882ac-bd36-4128-89e0-7accb7144bba tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:48.284026 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ffc882ac-bd36-4128-89e0-7accb7144bba tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1454 microversion: 2.1 time: 0.160173 Aug 02 09:17:48.284619 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 600/1208] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:48 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:50.265292 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4c9fdb22-34e3-4f9f-a636-1b8b80784a67 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:50.272024 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c9fdb22-34e3-4f9f-a636-1b8b80784a67 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.272470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c9fdb22-34e3-4f9f-a636-1b8b80784a67 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.335698 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4c9fdb22-34e3-4f9f-a636-1b8b80784a67 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Going to try to stop instance {{(pid=118366) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 09:17:50.548349 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-f3708e62-8ace-4182-b06c-88bba8d31bf0 req-a5e21581-ea6f-4705-94fc-f7f4e731d334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84201b1d-a6e9-4de9-a793-9c6066555bfe", "tag": "f6ec0826-e49f-499a-a8e4-e5a74769a605"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:50.557851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-f3708e62-8ace-4182-b06c-88bba8d31bf0 req-a5e21581-ea6f-4705-94fc-f7f4e731d334 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.558587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-f3708e62-8ace-4182-b06c-88bba8d31bf0 req-a5e21581-ea6f-4705-94fc-f7f4e731d334 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.570001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-f3708e62-8ace-4182-b06c-88bba8d31bf0 req-a5e21581-ea6f-4705-94fc-f7f4e731d334 service nova] Creating event network-changed:f6ec0826-e49f-499a-a8e4-e5a74769a605 for instance 84201b1d-a6e9-4de9-a793-9c6066555bfe on hv-cinder-84713 Aug 02 09:17:50.573561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4c9fdb22-34e3-4f9f-a636-1b8b80784a67 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/action" status: 202 len: 0 microversion: 2.1 time: 0.309813 Aug 02 09:17:50.573561 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 609/1209] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:17:50 2022] POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:17:50.575507 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-f3708e62-8ace-4182-b06c-88bba8d31bf0 req-a5e21581-ea6f-4705-94fc-f7f4e731d334 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095960 Aug 02 09:17:50.576203 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 601/1210] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:50.583949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6537e32d-4546-47bf-9d20-a0b9a33de9dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:50.584639 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6537e32d-4546-47bf-9d20-a0b9a33de9dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:50.591306 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6537e32d-4546-47bf-9d20-a0b9a33de9dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.606189 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6537e32d-4546-47bf-9d20-a0b9a33de9dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.607302 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6537e32d-4546-47bf-9d20-a0b9a33de9dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.607898 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6537e32d-4546-47bf-9d20-a0b9a33de9dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.765632 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6537e32d-4546-47bf-9d20-a0b9a33de9dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:50.773918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6537e32d-4546-47bf-9d20-a0b9a33de9dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.197343 Aug 02 09:17:50.774500 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 610/1211] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:50 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:51.796218 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a68cbed9-c6b5-493a-aa75-c2bd9755bc73 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:51.796884 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a68cbed9-c6b5-493a-aa75-c2bd9755bc73 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:51.803444 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a68cbed9-c6b5-493a-aa75-c2bd9755bc73 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.803889 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a68cbed9-c6b5-493a-aa75-c2bd9755bc73 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.804646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a68cbed9-c6b5-493a-aa75-c2bd9755bc73 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.805074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a68cbed9-c6b5-493a-aa75-c2bd9755bc73 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.846436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-744827c4-dc99-4b02-9b29-ac0bedc03b98 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:51.847010 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-744827c4-dc99-4b02-9b29-ac0bedc03b98 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:51.853563 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-744827c4-dc99-4b02-9b29-ac0bedc03b98 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.854043 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-744827c4-dc99-4b02-9b29-ac0bedc03b98 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.854810 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-744827c4-dc99-4b02-9b29-ac0bedc03b98 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.855244 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-744827c4-dc99-4b02-9b29-ac0bedc03b98 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.879887 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-744827c4-dc99-4b02-9b29-ac0bedc03b98 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lazy-loading 'flavor' on Instance uuid c7229a9c-5e58-4508-815a-5b5c0ed5f54b {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:17:51.963804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a68cbed9-c6b5-493a-aa75-c2bd9755bc73 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:51.970211 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:51.975117 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a68cbed9-c6b5-493a-aa75-c2bd9755bc73 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.183052 Aug 02 09:17:51.977302 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 602/1212] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:51 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:52.154206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-744827c4-dc99-4b02-9b29-ac0bedc03b98 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "POST /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b/action" status: 202 len: 0 microversion: 2.1 time: 0.311323 Aug 02 09:17:52.154716 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 611/1213] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:17:51 2022] POST /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:17:52.162992 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-dbb53d96-7f6f-4c65-9f74-4c328f7fc997 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:52.163604 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-dbb53d96-7f6f-4c65-9f74-4c328f7fc997 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:52.170294 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dbb53d96-7f6f-4c65-9f74-4c328f7fc997 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.170728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dbb53d96-7f6f-4c65-9f74-4c328f7fc997 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.172007 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dbb53d96-7f6f-4c65-9f74-4c328f7fc997 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.172441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-dbb53d96-7f6f-4c65-9f74-4c328f7fc997 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.309104 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-dbb53d96-7f6f-4c65-9f74-4c328f7fc997 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:52.317461 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-dbb53d96-7f6f-4c65-9f74-4c328f7fc997 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.158356 Aug 02 09:17:52.318058 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 603/1214] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:52 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:52.997405 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e5ceafac-272d-49c6-9b00-01481b18649f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:52.998046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e5ceafac-272d-49c6-9b00-01481b18649f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:53.004470 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e5ceafac-272d-49c6-9b00-01481b18649f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.004914 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e5ceafac-272d-49c6-9b00-01481b18649f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.005711 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e5ceafac-272d-49c6-9b00-01481b18649f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.006183 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e5ceafac-272d-49c6-9b00-01481b18649f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.138389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e5ceafac-272d-49c6-9b00-01481b18649f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:53.146922 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e5ceafac-272d-49c6-9b00-01481b18649f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.154644 Aug 02 09:17:53.147489 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 612/1215] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:52 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:53.339363 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-230ba74a-d9b3-4078-bbee-b262edd6d957 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:53.339963 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-230ba74a-d9b3-4078-bbee-b262edd6d957 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:53.346717 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-230ba74a-d9b3-4078-bbee-b262edd6d957 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.347221 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-230ba74a-d9b3-4078-bbee-b262edd6d957 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.348021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-230ba74a-d9b3-4078-bbee-b262edd6d957 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.348454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-230ba74a-d9b3-4078-bbee-b262edd6d957 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.490347 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-230ba74a-d9b3-4078-bbee-b262edd6d957 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:53.501173 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-230ba74a-d9b3-4078-bbee-b262edd6d957 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.165467 Aug 02 09:17:53.501751 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 604/1216] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:53 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:54.169029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-24a98c02-f3e9-4956-a576-997601a75598 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:54.169652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-24a98c02-f3e9-4956-a576-997601a75598 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:54.172433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:54.179554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-24a98c02-f3e9-4956-a576-997601a75598 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.184726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-24a98c02-f3e9-4956-a576-997601a75598 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.184726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-24a98c02-f3e9-4956-a576-997601a75598 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.184726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-24a98c02-f3e9-4956-a576-997601a75598 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.319799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-24a98c02-f3e9-4956-a576-997601a75598 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:54.327773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-24a98c02-f3e9-4956-a576-997601a75598 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.162658 Aug 02 09:17:54.328348 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 613/1217] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:54 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:54.523905 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0d9c4623-d5dd-4f7b-b0eb-4d0832a51eb2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:54.524475 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0d9c4623-d5dd-4f7b-b0eb-4d0832a51eb2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:54.531061 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0d9c4623-d5dd-4f7b-b0eb-4d0832a51eb2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.531535 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0d9c4623-d5dd-4f7b-b0eb-4d0832a51eb2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.533562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0d9c4623-d5dd-4f7b-b0eb-4d0832a51eb2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.533562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0d9c4623-d5dd-4f7b-b0eb-4d0832a51eb2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.664400 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0d9c4623-d5dd-4f7b-b0eb-4d0832a51eb2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:54.671965 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0d9c4623-d5dd-4f7b-b0eb-4d0832a51eb2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.151942 Aug 02 09:17:54.672543 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 605/1218] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:54 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:55.351185 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cb29c995-7399-4f45-92b1-34df21114c22 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:55.351754 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cb29c995-7399-4f45-92b1-34df21114c22 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:55.358315 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cb29c995-7399-4f45-92b1-34df21114c22 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.358763 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cb29c995-7399-4f45-92b1-34df21114c22 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.359542 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cb29c995-7399-4f45-92b1-34df21114c22 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.359957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cb29c995-7399-4f45-92b1-34df21114c22 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.491745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-cb29c995-7399-4f45-92b1-34df21114c22 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:55.499859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cb29c995-7399-4f45-92b1-34df21114c22 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.152618 Aug 02 09:17:55.500493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 614/1219] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:55 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:55.694624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-587d250e-f3f4-490c-89bc-899b4f7d5945 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:55.695235 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-587d250e-f3f4-490c-89bc-899b4f7d5945 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:55.702177 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-587d250e-f3f4-490c-89bc-899b4f7d5945 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.702636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-587d250e-f3f4-490c-89bc-899b4f7d5945 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.703410 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-587d250e-f3f4-490c-89bc-899b4f7d5945 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.703916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-587d250e-f3f4-490c-89bc-899b4f7d5945 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.836063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-587d250e-f3f4-490c-89bc-899b4f7d5945 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:55.843939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-587d250e-f3f4-490c-89bc-899b4f7d5945 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.153024 Aug 02 09:17:55.844446 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 606/1220] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:55 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:56.521836 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-77bb5a56-453d-4413-bba5-e2f37ab45180 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:56.522468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-77bb5a56-453d-4413-bba5-e2f37ab45180 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:56.528882 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77bb5a56-453d-4413-bba5-e2f37ab45180 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.529324 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77bb5a56-453d-4413-bba5-e2f37ab45180 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.530101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77bb5a56-453d-4413-bba5-e2f37ab45180 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.530530 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-77bb5a56-453d-4413-bba5-e2f37ab45180 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.674156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-77bb5a56-453d-4413-bba5-e2f37ab45180 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:56.690527 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-77bb5a56-453d-4413-bba5-e2f37ab45180 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.172361 Aug 02 09:17:56.691391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 615/1221] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:56 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:56.865251 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1ed62dc3-04d6-43dd-8a32-b84c167af822 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:56.865845 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1ed62dc3-04d6-43dd-8a32-b84c167af822 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:56.872447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1ed62dc3-04d6-43dd-8a32-b84c167af822 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.872894 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1ed62dc3-04d6-43dd-8a32-b84c167af822 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.873684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1ed62dc3-04d6-43dd-8a32-b84c167af822 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.874142 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1ed62dc3-04d6-43dd-8a32-b84c167af822 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.012878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1ed62dc3-04d6-43dd-8a32-b84c167af822 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:57.020519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1ed62dc3-04d6-43dd-8a32-b84c167af822 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.159179 Aug 02 09:17:57.021092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 607/1222] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:56 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:57.712055 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-70db8fbd-4076-4dfb-9f84-c375b4c4f01f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:57.712592 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-70db8fbd-4076-4dfb-9f84-c375b4c4f01f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:57.719188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-70db8fbd-4076-4dfb-9f84-c375b4c4f01f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.720356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-70db8fbd-4076-4dfb-9f84-c375b4c4f01f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.721291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-70db8fbd-4076-4dfb-9f84-c375b4c4f01f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.721734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-70db8fbd-4076-4dfb-9f84-c375b4c4f01f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.855881 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-70db8fbd-4076-4dfb-9f84-c375b4c4f01f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:57.864628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-70db8fbd-4076-4dfb-9f84-c375b4c4f01f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.156482 Aug 02 09:17:57.865222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 616/1223] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:57 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:58.042939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6f3c7afc-cd42-4a0c-92fb-dbb5e63f7e7b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:58.043488 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6f3c7afc-cd42-4a0c-92fb-dbb5e63f7e7b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:58.050142 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6f3c7afc-cd42-4a0c-92fb-dbb5e63f7e7b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.050492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6f3c7afc-cd42-4a0c-92fb-dbb5e63f7e7b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.051250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6f3c7afc-cd42-4a0c-92fb-dbb5e63f7e7b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.051678 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6f3c7afc-cd42-4a0c-92fb-dbb5e63f7e7b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.055749 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=100 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:58.181923 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6f3c7afc-cd42-4a0c-92fb-dbb5e63f7e7b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:58.189620 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6f3c7afc-cd42-4a0c-92fb-dbb5e63f7e7b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.150764 Aug 02 09:17:58.190224 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 608/1224] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:58 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:58.885499 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-05663737-147b-457e-8360-410f321e5e68 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:58.886123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-05663737-147b-457e-8360-410f321e5e68 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:58.893164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05663737-147b-457e-8360-410f321e5e68 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.893607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05663737-147b-457e-8360-410f321e5e68 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.894394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05663737-147b-457e-8360-410f321e5e68 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.894818 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05663737-147b-457e-8360-410f321e5e68 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.032749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-05663737-147b-457e-8360-410f321e5e68 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:59.034618 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-05663737-147b-457e-8360-410f321e5e68 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.152948 Aug 02 09:17:59.035189 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 617/1225] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:58 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:59.211495 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7074bd77-8991-4b22-ba9c-34c76b1bf5b9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:59.212106 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7074bd77-8991-4b22-ba9c-34c76b1bf5b9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:59.218667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7074bd77-8991-4b22-ba9c-34c76b1bf5b9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.219111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7074bd77-8991-4b22-ba9c-34c76b1bf5b9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.219990 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7074bd77-8991-4b22-ba9c-34c76b1bf5b9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.220423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7074bd77-8991-4b22-ba9c-34c76b1bf5b9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.354874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7074bd77-8991-4b22-ba9c-34c76b1bf5b9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:59.362479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7074bd77-8991-4b22-ba9c-34c76b1bf5b9 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.154867 Aug 02 09:17:59.363051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 609/1226] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:59 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:00.056217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-97a66bfe-3326-4b48-9c90-8c0ec68c98f4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.056785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-97a66bfe-3326-4b48-9c90-8c0ec68c98f4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.063544 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97a66bfe-3326-4b48-9c90-8c0ec68c98f4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.063988 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97a66bfe-3326-4b48-9c90-8c0ec68c98f4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.064748 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97a66bfe-3326-4b48-9c90-8c0ec68c98f4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.065180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97a66bfe-3326-4b48-9c90-8c0ec68c98f4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.198078 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-97a66bfe-3326-4b48-9c90-8c0ec68c98f4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:00.207028 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-97a66bfe-3326-4b48-9c90-8c0ec68c98f4 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.154746 Aug 02 09:18:00.209109 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 618/1227] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:00 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:00.384589 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d7aad522-a7ac-4c4f-8659-34c69cb69f4c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.385133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d7aad522-a7ac-4c4f-8659-34c69cb69f4c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.387407 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=46 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:00.392778 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d7aad522-a7ac-4c4f-8659-34c69cb69f4c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.393220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d7aad522-a7ac-4c4f-8659-34c69cb69f4c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.394021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d7aad522-a7ac-4c4f-8659-34c69cb69f4c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.394456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d7aad522-a7ac-4c4f-8659-34c69cb69f4c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.527974 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d7aad522-a7ac-4c4f-8659-34c69cb69f4c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:00.536416 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d7aad522-a7ac-4c4f-8659-34c69cb69f4c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.155807 Aug 02 09:18:00.537182 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 610/1228] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:00 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:01.228662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ca389142-1ed4-4af2-837b-25b9249b760f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.229204 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ca389142-1ed4-4af2-837b-25b9249b760f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.236381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ca389142-1ed4-4af2-837b-25b9249b760f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.236829 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ca389142-1ed4-4af2-837b-25b9249b760f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.237591 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ca389142-1ed4-4af2-837b-25b9249b760f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.238078 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ca389142-1ed4-4af2-837b-25b9249b760f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.367296 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ca389142-1ed4-4af2-837b-25b9249b760f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:01.375513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ca389142-1ed4-4af2-837b-25b9249b760f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.150713 Aug 02 09:18:01.376074 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 619/1229] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:01.558485 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-235fe8b9-3649-4d8e-a59a-2910282877a1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.559187 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-235fe8b9-3649-4d8e-a59a-2910282877a1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.565624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-235fe8b9-3649-4d8e-a59a-2910282877a1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.566134 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-235fe8b9-3649-4d8e-a59a-2910282877a1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.566913 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-235fe8b9-3649-4d8e-a59a-2910282877a1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.567365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-235fe8b9-3649-4d8e-a59a-2910282877a1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.699737 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-235fe8b9-3649-4d8e-a59a-2910282877a1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:01.707942 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-235fe8b9-3649-4d8e-a59a-2910282877a1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.154006 Aug 02 09:18:01.708523 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 611/1230] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:02.397579 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4579734f-5c26-44ab-a5de-ad7b25186b37 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:02.398163 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4579734f-5c26-44ab-a5de-ad7b25186b37 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:02.404652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4579734f-5c26-44ab-a5de-ad7b25186b37 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.405103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4579734f-5c26-44ab-a5de-ad7b25186b37 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.405868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4579734f-5c26-44ab-a5de-ad7b25186b37 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.406326 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4579734f-5c26-44ab-a5de-ad7b25186b37 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.543018 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4579734f-5c26-44ab-a5de-ad7b25186b37 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:02.552218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4579734f-5c26-44ab-a5de-ad7b25186b37 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.158682 Aug 02 09:18:02.552792 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 620/1231] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:02 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:02.729837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-096f9575-8711-4de4-aa4a-dcdb4db2d12c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:02.730505 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-096f9575-8711-4de4-aa4a-dcdb4db2d12c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:02.737406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-096f9575-8711-4de4-aa4a-dcdb4db2d12c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.737860 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-096f9575-8711-4de4-aa4a-dcdb4db2d12c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.738665 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-096f9575-8711-4de4-aa4a-dcdb4db2d12c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.739097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-096f9575-8711-4de4-aa4a-dcdb4db2d12c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.962419 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-096f9575-8711-4de4-aa4a-dcdb4db2d12c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:02.970687 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-096f9575-8711-4de4-aa4a-dcdb4db2d12c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.244602 Aug 02 09:18:02.971201 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 612/1232] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:02 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:03.572723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0a2d184c-6321-40ff-be4b-db4085f14794 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.573320 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0a2d184c-6321-40ff-be4b-db4085f14794 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:03.580655 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0a2d184c-6321-40ff-be4b-db4085f14794 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.581109 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0a2d184c-6321-40ff-be4b-db4085f14794 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.581902 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0a2d184c-6321-40ff-be4b-db4085f14794 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.582340 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0a2d184c-6321-40ff-be4b-db4085f14794 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.713659 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0a2d184c-6321-40ff-be4b-db4085f14794 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:03.722020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0a2d184c-6321-40ff-be4b-db4085f14794 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.153116 Aug 02 09:18:03.722608 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 621/1233] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:03.991989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-1999b5f0-f429-439a-ac11-ec392275d65c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.992588 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-1999b5f0-f429-439a-ac11-ec392275d65c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:03.999033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1999b5f0-f429-439a-ac11-ec392275d65c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.999477 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1999b5f0-f429-439a-ac11-ec392275d65c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.000919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1999b5f0-f429-439a-ac11-ec392275d65c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.001359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-1999b5f0-f429-439a-ac11-ec392275d65c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.133621 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-1999b5f0-f429-439a-ac11-ec392275d65c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:04.141297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-1999b5f0-f429-439a-ac11-ec392275d65c tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.153134 Aug 02 09:18:04.144903 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 613/1234] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:04.743066 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-18d1df03-8287-4d5f-8a54-ddaa88ea50ab tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:04.743654 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-18d1df03-8287-4d5f-8a54-ddaa88ea50ab tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:04.750164 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18d1df03-8287-4d5f-8a54-ddaa88ea50ab tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.751206 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18d1df03-8287-4d5f-8a54-ddaa88ea50ab tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.751997 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18d1df03-8287-4d5f-8a54-ddaa88ea50ab tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.752454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-18d1df03-8287-4d5f-8a54-ddaa88ea50ab tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.881383 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-18d1df03-8287-4d5f-8a54-ddaa88ea50ab tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:04.889958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-18d1df03-8287-4d5f-8a54-ddaa88ea50ab tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.150762 Aug 02 09:18:04.890816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 622/1235] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:04 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:05.163108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-49a2e587-a170-4926-a8f3-d29a7372c6fa tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.168213 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-49a2e587-a170-4926-a8f3-d29a7372c6fa tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.170246 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49a2e587-a170-4926-a8f3-d29a7372c6fa tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.170695 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49a2e587-a170-4926-a8f3-d29a7372c6fa tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.171573 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49a2e587-a170-4926-a8f3-d29a7372c6fa tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.172095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-49a2e587-a170-4926-a8f3-d29a7372c6fa tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.314179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-49a2e587-a170-4926-a8f3-d29a7372c6fa tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:05.321624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-49a2e587-a170-4926-a8f3-d29a7372c6fa tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.162362 Aug 02 09:18:05.322229 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 614/1236] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:05.911422 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a16a6cb7-29a8-4a71-9259-91a5b2cf274e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.912107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a16a6cb7-29a8-4a71-9259-91a5b2cf274e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.918652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a16a6cb7-29a8-4a71-9259-91a5b2cf274e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.919105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a16a6cb7-29a8-4a71-9259-91a5b2cf274e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.919874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a16a6cb7-29a8-4a71-9259-91a5b2cf274e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.920312 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a16a6cb7-29a8-4a71-9259-91a5b2cf274e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.054319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a16a6cb7-29a8-4a71-9259-91a5b2cf274e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:06.063232 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a16a6cb7-29a8-4a71-9259-91a5b2cf274e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1724 microversion: 2.1 time: 0.155105 Aug 02 09:18:06.063817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 623/1237] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:06.342940 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6a708c94-4b94-4133-8337-b99ecd1a6df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.344645 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6a708c94-4b94-4133-8337-b99ecd1a6df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.350597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a708c94-4b94-4133-8337-b99ecd1a6df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.351044 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a708c94-4b94-4133-8337-b99ecd1a6df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.351828 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a708c94-4b94-4133-8337-b99ecd1a6df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.352259 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a708c94-4b94-4133-8337-b99ecd1a6df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.486261 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-6a708c94-4b94-4133-8337-b99ecd1a6df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:06.493870 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6a708c94-4b94-4133-8337-b99ecd1a6df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1570 microversion: 2.1 time: 0.154968 Aug 02 09:18:06.496464 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 615/1238] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:06.516071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-aa0f0844-6442-41ef-8150-2e41db0c5145 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:06.516667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-aa0f0844-6442-41ef-8150-2e41db0c5145 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.522909 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa0f0844-6442-41ef-8150-2e41db0c5145 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.523357 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa0f0844-6442-41ef-8150-2e41db0c5145 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.534529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa0f0844-6442-41ef-8150-2e41db0c5145 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.534529 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-aa0f0844-6442-41ef-8150-2e41db0c5145 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.568981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-aa0f0844-6442-41ef-8150-2e41db0c5145 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118366) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:18:06.870222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-aa0f0844-6442-41ef-8150-2e41db0c5145 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "POST /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b/action" status: 202 len: 0 microversion: 2.1 time: 0.358220 Aug 02 09:18:06.871024 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 624/1239] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:18:06 2022] POST /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:06.879450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7bfbbdcc-214e-4213-af79-600a0f441f9d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.880064 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7bfbbdcc-214e-4213-af79-600a0f441f9d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.886140 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7bfbbdcc-214e-4213-af79-600a0f441f9d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.886592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7bfbbdcc-214e-4213-af79-600a0f441f9d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.887359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7bfbbdcc-214e-4213-af79-600a0f441f9d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.887796 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7bfbbdcc-214e-4213-af79-600a0f441f9d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.026123 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7bfbbdcc-214e-4213-af79-600a0f441f9d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.033910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7bfbbdcc-214e-4213-af79-600a0f441f9d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1518 microversion: 2.1 time: 0.158706 Aug 02 09:18:07.034804 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 616/1240] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:07.084480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-75f69f7e-f35c-4e6a-aed2-ff59f60dbf38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:07.085098 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-75f69f7e-f35c-4e6a-aed2-ff59f60dbf38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:07.091441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-75f69f7e-f35c-4e6a-aed2-ff59f60dbf38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.091892 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-75f69f7e-f35c-4e6a-aed2-ff59f60dbf38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.092693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-75f69f7e-f35c-4e6a-aed2-ff59f60dbf38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.093129 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-75f69f7e-f35c-4e6a-aed2-ff59f60dbf38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.226512 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-75f69f7e-f35c-4e6a-aed2-ff59f60dbf38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.235145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-75f69f7e-f35c-4e6a-aed2-ff59f60dbf38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1701 microversion: 2.1 time: 0.154400 Aug 02 09:18:07.235710 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 625/1241] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:07 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:07.262435 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-09a90f9d-d522-49de-8ac7-637622483a6a tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:07.269190 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09a90f9d-d522-49de-8ac7-637622483a6a tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.269653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-09a90f9d-d522-49de-8ac7-637622483a6a tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.330943 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-09a90f9d-d522-49de-8ac7-637622483a6a tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Going to try to start instance {{(pid=118368) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 09:18:07.529194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-09a90f9d-d522-49de-8ac7-637622483a6a tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/action" status: 202 len: 0 microversion: 2.1 time: 0.270381 Aug 02 09:18:07.529925 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 617/1242] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:18:07 2022] POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:07.538389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0feca0b7-0d6d-47c6-b8ca-82d446ab9984 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:07.539148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0feca0b7-0d6d-47c6-b8ca-82d446ab9984 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:07.545722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0feca0b7-0d6d-47c6-b8ca-82d446ab9984 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.551965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0feca0b7-0d6d-47c6-b8ca-82d446ab9984 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.552888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0feca0b7-0d6d-47c6-b8ca-82d446ab9984 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.553535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0feca0b7-0d6d-47c6-b8ca-82d446ab9984 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.558839 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:07.663423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-81297da7-29d5-4a77-8fbf-1aa613ab46ee req-0e2d0915-806d-46b2-9907-0889661fa0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7229a9c-5e58-4508-815a-5b5c0ed5f54b", "name": "network-vif-unplugged", "status": "completed", "tag": "5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:07.674658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-81297da7-29d5-4a77-8fbf-1aa613ab46ee req-0e2d0915-806d-46b2-9907-0889661fa0c2 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.675097 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-81297da7-29d5-4a77-8fbf-1aa613ab46ee req-0e2d0915-806d-46b2-9907-0889661fa0c2 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.687049 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.compute.server_external_events [req-81297da7-29d5-4a77-8fbf-1aa613ab46ee req-0e2d0915-806d-46b2-9907-0889661fa0c2 service nova] Unable to find a host for instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b. Dropping event network-vif-unplugged {{(pid=118368) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 09:18:07.687960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-81297da7-29d5-4a77-8fbf-1aa613ab46ee req-0e2d0915-806d-46b2-9907-0889661fa0c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030607 Aug 02 09:18:07.689017 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 618/1243] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 02 09:18:07.708473 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0feca0b7-0d6d-47c6-b8ca-82d446ab9984 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.717437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0feca0b7-0d6d-47c6-b8ca-82d446ab9984 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1710 microversion: 2.1 time: 0.183017 Aug 02 09:18:07.718103 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 626/1244] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:07 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:08.057533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0fd140be-4234-4211-9397-3ae350bd9ac8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.058710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0fd140be-4234-4211-9397-3ae350bd9ac8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.068103 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0fd140be-4234-4211-9397-3ae350bd9ac8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.068696 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0fd140be-4234-4211-9397-3ae350bd9ac8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.070512 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0fd140be-4234-4211-9397-3ae350bd9ac8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.070981 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0fd140be-4234-4211-9397-3ae350bd9ac8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.287863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:18:08.288235 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:18:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b (ip 10.222.0.46) !!! Aug 02 09:18:08.334493 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0fd140be-4234-4211-9397-3ae350bd9ac8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:08.344880 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0fd140be-4234-4211-9397-3ae350bd9ac8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1520 microversion: 2.1 time: 0.292602 Aug 02 09:18:08.345462 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 619/1245] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:08.738811 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-51431ed7-5842-4c36-8a59-79644db38e11 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.739410 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-51431ed7-5842-4c36-8a59-79644db38e11 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.746789 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-51431ed7-5842-4c36-8a59-79644db38e11 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.747240 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-51431ed7-5842-4c36-8a59-79644db38e11 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.748016 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-51431ed7-5842-4c36-8a59-79644db38e11 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.748448 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-51431ed7-5842-4c36-8a59-79644db38e11 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.885912 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-51431ed7-5842-4c36-8a59-79644db38e11 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:08.895026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-51431ed7-5842-4c36-8a59-79644db38e11 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1710 microversion: 2.1 time: 0.159954 Aug 02 09:18:08.895630 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 627/1246] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:09.372653 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fedc54ed-89d4-4ef4-bda5-d293634d02a2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:09.373196 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fedc54ed-89d4-4ef4-bda5-d293634d02a2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:09.380362 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fedc54ed-89d4-4ef4-bda5-d293634d02a2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.380810 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fedc54ed-89d4-4ef4-bda5-d293634d02a2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.381574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fedc54ed-89d4-4ef4-bda5-d293634d02a2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.382040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fedc54ed-89d4-4ef4-bda5-d293634d02a2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.517215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fedc54ed-89d4-4ef4-bda5-d293634d02a2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:09.524776 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fedc54ed-89d4-4ef4-bda5-d293634d02a2 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1520 microversion: 2.1 time: 0.156041 Aug 02 09:18:09.525349 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 620/1247] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:09 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:09.917359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e3a5ece8-9185-4caf-a752-6cfcda1eff50 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:09.918035 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e3a5ece8-9185-4caf-a752-6cfcda1eff50 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:09.925146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3a5ece8-9185-4caf-a752-6cfcda1eff50 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.925608 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3a5ece8-9185-4caf-a752-6cfcda1eff50 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.926424 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3a5ece8-9185-4caf-a752-6cfcda1eff50 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.926874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e3a5ece8-9185-4caf-a752-6cfcda1eff50 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.066939 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e3a5ece8-9185-4caf-a752-6cfcda1eff50 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:10.075129 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e3a5ece8-9185-4caf-a752-6cfcda1eff50 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1714 microversion: 2.1 time: 0.161699 Aug 02 09:18:10.075700 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 628/1248] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:09 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:10.532484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a1be5af2-e628-4544-982d-d1b370ffec80 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.532960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a1be5af2-e628-4544-982d-d1b370ffec80 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.539515 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a1be5af2-e628-4544-982d-d1b370ffec80 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.539968 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a1be5af2-e628-4544-982d-d1b370ffec80 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.540736 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a1be5af2-e628-4544-982d-d1b370ffec80 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.541288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a1be5af2-e628-4544-982d-d1b370ffec80 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.546402 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-961ae151-d171-4448-ae33-87c3f7ef241a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.547652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-961ae151-d171-4448-ae33-87c3f7ef241a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.554053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-961ae151-d171-4448-ae33-87c3f7ef241a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.554509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-961ae151-d171-4448-ae33-87c3f7ef241a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.555287 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-961ae151-d171-4448-ae33-87c3f7ef241a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.555727 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-961ae151-d171-4448-ae33-87c3f7ef241a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.565781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a1be5af2-e628-4544-982d-d1b370ffec80 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/ips" status: 200 len: 148 microversion: 2.1 time: 0.037729 Aug 02 09:18:10.566659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 621/1249] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:10.698327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-961ae151-d171-4448-ae33-87c3f7ef241a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:10.707835 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-961ae151-d171-4448-ae33-87c3f7ef241a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.165167 Aug 02 09:18:10.712269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 629/1250] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:11.730364 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4b839777-542d-4419-877f-6272cf397df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.730978 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4b839777-542d-4419-877f-6272cf397df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:11.738120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b839777-542d-4419-877f-6272cf397df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.738578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b839777-542d-4419-877f-6272cf397df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.739342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b839777-542d-4419-877f-6272cf397df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.739778 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b839777-542d-4419-877f-6272cf397df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.872449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4b839777-542d-4419-877f-6272cf397df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:11.880509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4b839777-542d-4419-877f-6272cf397df7 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.154054 Aug 02 09:18:11.881084 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 622/1251] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:11 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:12.902435 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-07a6c6f4-1c47-4e0c-ac02-ec82c8574570 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.903026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-07a6c6f4-1c47-4e0c-ac02-ec82c8574570 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.909723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07a6c6f4-1c47-4e0c-ac02-ec82c8574570 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.910196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07a6c6f4-1c47-4e0c-ac02-ec82c8574570 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.910960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07a6c6f4-1c47-4e0c-ac02-ec82c8574570 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.911396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-07a6c6f4-1c47-4e0c-ac02-ec82c8574570 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.043943 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-07a6c6f4-1c47-4e0c-ac02-ec82c8574570 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:13.052397 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-07a6c6f4-1c47-4e0c-ac02-ec82c8574570 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.153843 Aug 02 09:18:13.052972 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 630/1252] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:12 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:13.264611 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ae5cebfd-67b6-42c1-b322-9de7c6c28170 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dba0d36-b24a-4d2d-a450-b8596f1dc1a0"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:13.267063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ae5cebfd-67b6-42c1-b322-9de7c6c28170 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.273682 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae5cebfd-67b6-42c1-b322-9de7c6c28170 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.274165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae5cebfd-67b6-42c1-b322-9de7c6c28170 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.274926 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae5cebfd-67b6-42c1-b322-9de7c6c28170 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.275358 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ae5cebfd-67b6-42c1-b322-9de7c6c28170 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.779610 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:13.941944 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ae5cebfd-67b6-42c1-b322-9de7c6c28170 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "POST /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680682 Aug 02 09:18:13.942332 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 623/1253] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:18:13 2022] POST /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:14.074889 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-88c482f3-06d6-46f5-a21c-98dc532b02e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.075489 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-88c482f3-06d6-46f5-a21c-98dc532b02e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.082665 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88c482f3-06d6-46f5-a21c-98dc532b02e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.083167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88c482f3-06d6-46f5-a21c-98dc532b02e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.083912 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88c482f3-06d6-46f5-a21c-98dc532b02e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.084345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-88c482f3-06d6-46f5-a21c-98dc532b02e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.222031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-88c482f3-06d6-46f5-a21c-98dc532b02e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:14.229740 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-88c482f3-06d6-46f5-a21c-98dc532b02e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.158688 Aug 02 09:18:14.230340 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 631/1254] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:15.254277 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ed7c19f2-1568-48fd-9a43-5598a0f13cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.254858 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ed7c19f2-1568-48fd-9a43-5598a0f13cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.261740 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ed7c19f2-1568-48fd-9a43-5598a0f13cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.262220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ed7c19f2-1568-48fd-9a43-5598a0f13cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.262972 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ed7c19f2-1568-48fd-9a43-5598a0f13cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.263398 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ed7c19f2-1568-48fd-9a43-5598a0f13cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.395876 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ed7c19f2-1568-48fd-9a43-5598a0f13cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:15.403404 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ed7c19f2-1568-48fd-9a43-5598a0f13cc1 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.154515 Aug 02 09:18:15.403972 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 624/1255] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:16.426619 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9e86ddeb-0e97-483c-91c0-81ce72f84c83 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:16.427235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9e86ddeb-0e97-483c-91c0-81ce72f84c83 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:16.434230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e86ddeb-0e97-483c-91c0-81ce72f84c83 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.434676 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e86ddeb-0e97-483c-91c0-81ce72f84c83 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.435459 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e86ddeb-0e97-483c-91c0-81ce72f84c83 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.435883 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9e86ddeb-0e97-483c-91c0-81ce72f84c83 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.572843 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9e86ddeb-0e97-483c-91c0-81ce72f84c83 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:16.582053 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9e86ddeb-0e97-483c-91c0-81ce72f84c83 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.160860 Aug 02 09:18:16.582831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 632/1256] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:16 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:17.614089 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-79f99277-5d88-4c74-a99f-1f8492693a2d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.614629 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-79f99277-5d88-4c74-a99f-1f8492693a2d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.621240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79f99277-5d88-4c74-a99f-1f8492693a2d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.622318 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79f99277-5d88-4c74-a99f-1f8492693a2d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.622471 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79f99277-5d88-4c74-a99f-1f8492693a2d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.622905 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-79f99277-5d88-4c74-a99f-1f8492693a2d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.754130 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-79f99277-5d88-4c74-a99f-1f8492693a2d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:17.762107 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-79f99277-5d88-4c74-a99f-1f8492693a2d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.151957 Aug 02 09:18:17.762676 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 625/1257] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:17 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:18.784033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2497257d-a283-49e8-8043-81a44ed826ac tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:18.784638 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2497257d-a283-49e8-8043-81a44ed826ac tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:18.791204 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2497257d-a283-49e8-8043-81a44ed826ac tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.791648 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2497257d-a283-49e8-8043-81a44ed826ac tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.792429 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2497257d-a283-49e8-8043-81a44ed826ac tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.792864 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2497257d-a283-49e8-8043-81a44ed826ac tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.929553 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2497257d-a283-49e8-8043-81a44ed826ac tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:18.938036 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2497257d-a283-49e8-8043-81a44ed826ac tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.157254 Aug 02 09:18:18.938608 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 633/1258] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:18 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:19.959129 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0deb475e-a282-4450-8c15-e8c0191cd7a8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:19.959734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0deb475e-a282-4450-8c15-e8c0191cd7a8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:19.966201 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0deb475e-a282-4450-8c15-e8c0191cd7a8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.966641 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0deb475e-a282-4450-8c15-e8c0191cd7a8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.967389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0deb475e-a282-4450-8c15-e8c0191cd7a8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.967815 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0deb475e-a282-4450-8c15-e8c0191cd7a8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.105829 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0deb475e-a282-4450-8c15-e8c0191cd7a8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:20.113850 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0deb475e-a282-4450-8c15-e8c0191cd7a8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.158482 Aug 02 09:18:20.114443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 626/1259] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:19 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:21.135288 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1c1617d6-2fec-4ced-a616-d8c2243430e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.135816 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1c1617d6-2fec-4ced-a616-d8c2243430e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.143101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c1617d6-2fec-4ced-a616-d8c2243430e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.143554 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c1617d6-2fec-4ced-a616-d8c2243430e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.144315 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c1617d6-2fec-4ced-a616-d8c2243430e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.144749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1c1617d6-2fec-4ced-a616-d8c2243430e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.276732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1c1617d6-2fec-4ced-a616-d8c2243430e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:21.284222 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1c1617d6-2fec-4ced-a616-d8c2243430e3 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.152905 Aug 02 09:18:21.284785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 634/1260] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:21.754562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-a8ae187c-8cad-4fc0-a930-59e87032e931 req-5d7b87b9-ae18-40c7-8043-dc2d36778af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7229a9c-5e58-4508-815a-5b5c0ed5f54b", "name": "network-vif-plugged", "status": "completed", "tag": "5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:21.764799 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-a8ae187c-8cad-4fc0-a930-59e87032e931 req-5d7b87b9-ae18-40c7-8043-dc2d36778af9 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.765852 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-a8ae187c-8cad-4fc0-a930-59e87032e931 req-5d7b87b9-ae18-40c7-8043-dc2d36778af9 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.778178 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-a8ae187c-8cad-4fc0-a930-59e87032e931 req-5d7b87b9-ae18-40c7-8043-dc2d36778af9 service nova] Creating event network-vif-plugged:5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11 for instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b on hv-cinder-84713 Aug 02 09:18:21.783794 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-a8ae187c-8cad-4fc0-a930-59e87032e931 req-5d7b87b9-ae18-40c7-8043-dc2d36778af9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033746 Aug 02 09:18:21.788704 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 627/1261] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:22.308749 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8f597a44-4997-4c1e-8e5f-7c9b10f0da3d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.309327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8f597a44-4997-4c1e-8e5f-7c9b10f0da3d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.320888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8f597a44-4997-4c1e-8e5f-7c9b10f0da3d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.321334 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8f597a44-4997-4c1e-8e5f-7c9b10f0da3d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.322138 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8f597a44-4997-4c1e-8e5f-7c9b10f0da3d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.322568 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8f597a44-4997-4c1e-8e5f-7c9b10f0da3d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.458550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8f597a44-4997-4c1e-8e5f-7c9b10f0da3d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:22.466145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8f597a44-4997-4c1e-8e5f-7c9b10f0da3d tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.161405 Aug 02 09:18:22.466705 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 635/1262] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:22.624116 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e8a4da68-a34a-44e1-b5b2-7f8b78d50747 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.625181 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e8a4da68-a34a-44e1-b5b2-7f8b78d50747 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.631300 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8a4da68-a34a-44e1-b5b2-7f8b78d50747 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.631742 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8a4da68-a34a-44e1-b5b2-7f8b78d50747 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.632492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8a4da68-a34a-44e1-b5b2-7f8b78d50747 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.632916 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8a4da68-a34a-44e1-b5b2-7f8b78d50747 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.713550 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-e8a4da68-a34a-44e1-b5b2-7f8b78d50747 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lazy-loading 'services' on Instance uuid dd428921-4950-4abc-9030-0ee67d03584d {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:22.926343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e8a4da68-a34a-44e1-b5b2-7f8b78d50747 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments/1dba0d36-b24a-4d2d-a450-b8596f1dc1a0" status: 202 len: 0 microversion: 2.1 time: 0.306197 Aug 02 09:18:22.927044 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 628/1263] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:18:22 2022] DELETE /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments/1dba0d36-b24a-4d2d-a450-b8596f1dc1a0 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:22.935693 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-db3fe8eb-39c2-4a7e-ae46-cec49dc1961d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.938233 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-db3fe8eb-39c2-4a7e-ae46-cec49dc1961d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.944677 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-db3fe8eb-39c2-4a7e-ae46-cec49dc1961d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.945133 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-db3fe8eb-39c2-4a7e-ae46-cec49dc1961d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.945957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-db3fe8eb-39c2-4a7e-ae46-cec49dc1961d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.946398 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-db3fe8eb-39c2-4a7e-ae46-cec49dc1961d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.980425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-db3fe8eb-39c2-4a7e-ae46-cec49dc1961d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Aug 02 09:18:22.980425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 636/1264] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:23.488151 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f35c987e-470d-4c56-965b-ac6fe82feabc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:23.488837 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f35c987e-470d-4c56-965b-ac6fe82feabc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:23.495283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f35c987e-470d-4c56-965b-ac6fe82feabc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.495728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f35c987e-470d-4c56-965b-ac6fe82feabc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.496520 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f35c987e-470d-4c56-965b-ac6fe82feabc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.496951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f35c987e-470d-4c56-965b-ac6fe82feabc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.627893 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f35c987e-470d-4c56-965b-ac6fe82feabc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:23.635317 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f35c987e-470d-4c56-965b-ac6fe82feabc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1576 microversion: 2.1 time: 0.151675 Aug 02 09:18:23.635883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 629/1265] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:23 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:23.991154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-445b32fc-3efc-4837-ae09-f6a3259931de tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:23.993353 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-445b32fc-3efc-4837-ae09-f6a3259931de tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:24.000308 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-445b32fc-3efc-4837-ae09-f6a3259931de tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.000746 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-445b32fc-3efc-4837-ae09-f6a3259931de tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.001504 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-445b32fc-3efc-4837-ae09-f6a3259931de tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.001957 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-445b32fc-3efc-4837-ae09-f6a3259931de tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.031351 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-445b32fc-3efc-4837-ae09-f6a3259931de tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044116 Aug 02 09:18:24.031925 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 637/1266] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:23 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:24.657073 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-df84959c-fc8b-4d06-8e7d-d75027250247 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:24.658113 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-df84959c-fc8b-4d06-8e7d-d75027250247 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:24.664882 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df84959c-fc8b-4d06-8e7d-d75027250247 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.665332 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df84959c-fc8b-4d06-8e7d-d75027250247 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.666128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df84959c-fc8b-4d06-8e7d-d75027250247 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.666561 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-df84959c-fc8b-4d06-8e7d-d75027250247 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.809969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-df84959c-fc8b-4d06-8e7d-d75027250247 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:24.817830 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-df84959c-fc8b-4d06-8e7d-d75027250247 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1563 microversion: 2.1 time: 0.165291 Aug 02 09:18:24.818430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 630/1267] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:24 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:25.043662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-42e814f0-5c9e-4abc-8a76-f8ce87a1a0bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:25.045807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-42e814f0-5c9e-4abc-8a76-f8ce87a1a0bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:25.051528 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:25.052854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42e814f0-5c9e-4abc-8a76-f8ce87a1a0bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.053304 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42e814f0-5c9e-4abc-8a76-f8ce87a1a0bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.054087 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42e814f0-5c9e-4abc-8a76-f8ce87a1a0bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.054514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42e814f0-5c9e-4abc-8a76-f8ce87a1a0bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.084361 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-42e814f0-5c9e-4abc-8a76-f8ce87a1a0bd tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Aug 02 09:18:25.084910 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 638/1268] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:25 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:26.096905 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fea9a66a-2386-4a25-a877-58796c7768f6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.099164 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fea9a66a-2386-4a25-a877-58796c7768f6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.105670 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fea9a66a-2386-4a25-a877-58796c7768f6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.106165 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fea9a66a-2386-4a25-a877-58796c7768f6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.106926 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fea9a66a-2386-4a25-a877-58796c7768f6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.107360 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fea9a66a-2386-4a25-a877-58796c7768f6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.136445 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fea9a66a-2386-4a25-a877-58796c7768f6 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043506 Aug 02 09:18:26.137001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 631/1269] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:18:26.197839 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5c1b1839-c1e7-47af-a51c-d68cd272dbe8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.198376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5c1b1839-c1e7-47af-a51c-d68cd272dbe8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.205796 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5c1b1839-c1e7-47af-a51c-d68cd272dbe8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.206269 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5c1b1839-c1e7-47af-a51c-d68cd272dbe8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.207031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5c1b1839-c1e7-47af-a51c-d68cd272dbe8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.207522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5c1b1839-c1e7-47af-a51c-d68cd272dbe8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.233444 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5c1b1839-c1e7-47af-a51c-d68cd272dbe8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:18:26.463661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5c1b1839-c1e7-47af-a51c-d68cd272dbe8 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 204 len: 0 microversion: 2.1 time: 0.269273 Aug 02 09:18:26.464209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 639/1270] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:26 2022] DELETE /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:18:26.473632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-86c9eebf-1ac4-48ef-8585-692f3a37a383 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.474553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-86c9eebf-1ac4-48ef-8585-692f3a37a383 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.481065 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-86c9eebf-1ac4-48ef-8585-692f3a37a383 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.481513 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-86c9eebf-1ac4-48ef-8585-692f3a37a383 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.482310 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-86c9eebf-1ac4-48ef-8585-692f3a37a383 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.482741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-86c9eebf-1ac4-48ef-8585-692f3a37a383 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.610524 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-86c9eebf-1ac4-48ef-8585-692f3a37a383 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:26.617901 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-86c9eebf-1ac4-48ef-8585-692f3a37a383 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1678 microversion: 2.1 time: 0.148784 Aug 02 09:18:26.618468 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 632/1271] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:27.639783 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-cf1b5d29-527c-4ef6-89ea-842b54acd3c3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:27.640484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-cf1b5d29-527c-4ef6-89ea-842b54acd3c3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:27.647061 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cf1b5d29-527c-4ef6-89ea-842b54acd3c3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.647514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cf1b5d29-527c-4ef6-89ea-842b54acd3c3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.648282 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cf1b5d29-527c-4ef6-89ea-842b54acd3c3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.648721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-cf1b5d29-527c-4ef6-89ea-842b54acd3c3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.776982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-cf1b5d29-527c-4ef6-89ea-842b54acd3c3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:27.785430 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-cf1b5d29-527c-4ef6-89ea-842b54acd3c3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1678 microversion: 2.1 time: 0.149917 Aug 02 09:18:27.786031 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 640/1272] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:27 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:28.807248 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ab4264ac-7eae-4af1-b915-afef28ac5b0b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.808105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-ab4264ac-7eae-4af1-b915-afef28ac5b0b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:28.815630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ab4264ac-7eae-4af1-b915-afef28ac5b0b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.816373 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ab4264ac-7eae-4af1-b915-afef28ac5b0b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.817327 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ab4264ac-7eae-4af1-b915-afef28ac5b0b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.817765 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-ab4264ac-7eae-4af1-b915-afef28ac5b0b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.054027 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-ab4264ac-7eae-4af1-b915-afef28ac5b0b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:29.064606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ab4264ac-7eae-4af1-b915-afef28ac5b0b tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1678 microversion: 2.1 time: 0.261157 Aug 02 09:18:29.065330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 633/1273] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:29.989487 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-c49842a4-f0d0-4130-9da7-75c9b2812910 req-8330b4a5-8727-4aff-87f3-3f28a49c8f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd428921-4950-4abc-9030-0ee67d03584d", "name": "network-vif-deleted", "tag": "0cb4b587-e74a-4d56-a4c3-b98862618972"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:29.999692 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-c49842a4-f0d0-4130-9da7-75c9b2812910 req-8330b4a5-8727-4aff-87f3-3f28a49c8f84 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.000140 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-c49842a4-f0d0-4130-9da7-75c9b2812910 req-8330b4a5-8727-4aff-87f3-3f28a49c8f84 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.003360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:30.014419 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-c49842a4-f0d0-4130-9da7-75c9b2812910 req-8330b4a5-8727-4aff-87f3-3f28a49c8f84 service nova] Creating event network-vif-deleted:0cb4b587-e74a-4d56-a4c3-b98862618972 for instance dd428921-4950-4abc-9030-0ee67d03584d on hv-cinder-84713 Aug 02 09:18:30.020389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-c49842a4-f0d0-4130-9da7-75c9b2812910 req-8330b4a5-8727-4aff-87f3-3f28a49c8f84 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034264 Aug 02 09:18:30.021011 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 641/1274] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:30.090874 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5dcd2109-f063-419a-9d13-a476ce276cb9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.091590 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5dcd2109-f063-419a-9d13-a476ce276cb9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:30.100813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dcd2109-f063-419a-9d13-a476ce276cb9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.101336 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dcd2109-f063-419a-9d13-a476ce276cb9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.102556 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dcd2109-f063-419a-9d13-a476ce276cb9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.103057 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5dcd2109-f063-419a-9d13-a476ce276cb9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.185367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5dcd2109-f063-419a-9d13-a476ce276cb9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806f0c03435e4c5daeadaa4eb437d936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9df882a572a4bed8966779e50eb7e7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:30.194320 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5dcd2109-f063-419a-9d13-a476ce276cb9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 200 len: 1611 microversion: 2.1 time: 0.109731 Aug 02 09:18:30.197384 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 634/1275] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 1611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:31.216973 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.218376 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:31.226261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.230203 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.230203 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.230203 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.242203 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d HTTP/1.1 Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:31.243859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:31.245319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'dd428921-4950-4abc-9030-0ee67d03584d'} Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:31.246624 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:31.248270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.249918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:31.249918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ae9a1495-4028-457d-8002-89ee335110bf tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 404 len: 111 microversion: 2.1 time: 0.032560 Aug 02 09:18:31.249918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 642/1276] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:31.254639 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8e62ba19-8a4c-46e3-9bbd-4ccd14d10423 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '.version_select at 0x7f0f2d8304c0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.265500 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=50 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:31.337019 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8e62ba19-8a4c-46e3-9bbd-4ccd14d10423 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-27233177" status: 202 len: 0 microversion: 2.1 time: 0.086198 Aug 02 09:18:31.337553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 635/1277] 10.222.0.46 () {58 vars in 1215 bytes} [Tue Aug 2 09:18:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-27233177 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:33.378406 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:33.378912 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:33.385862 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.386330 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.387096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.387532 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.403160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d HTTP/1.1 Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:33.404817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.406427 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'dd428921-4950-4abc-9030-0ee67d03584d'} Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:33.407513 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.409001 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.410583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:33.410583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-41440fba-0cf2-480b-8256-1be9c471db36 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 404 len: 111 microversion: 2.1 time: 0.032731 Aug 02 09:18:33.410583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 643/1278] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:33 2022] DELETE /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:33.415677 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:33.416276 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dd428921-4950-4abc-9030-0ee67d03584d] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:33.423577 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.424020 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.424770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.425202 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.439050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d HTTP/1.1 Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:18:33.440661 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.442283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'dd428921-4950-4abc-9030-0ee67d03584d'} Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:33.443189 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. Aug 02 09:18:33.444774 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:33.446263 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dd428921-4950-4abc-9030-0ee67d03584d could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:33.446263 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-08b49232-3764-493f-9c91-2724e1f12fd9 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d" status: 404 len: 111 microversion: 2.1 time: 0.031209 Aug 02 09:18:33.446263 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 636/1279] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:33 2022] GET /compute/v2.1/servers/dd428921-4950-4abc-9030-0ee67d03584d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:34.041813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0c056225-7f24-4433-93fe-741e97ab2e06 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.043960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0c056225-7f24-4433-93fe-741e97ab2e06 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.050115 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c056225-7f24-4433-93fe-741e97ab2e06 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.050570 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c056225-7f24-4433-93fe-741e97ab2e06 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.051345 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c056225-7f24-4433-93fe-741e97ab2e06 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.051790 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0c056225-7f24-4433-93fe-741e97ab2e06 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.081480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0c056225-7f24-4433-93fe-741e97ab2e06 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043913 Aug 02 09:18:34.082094 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 644/1280] 10.222.0.46 () {60 vars in 1343 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:34.149662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d12adba8-3a82-4f57-b9c0-c0bf1d7d315f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.150191 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d12adba8-3a82-4f57-b9c0-c0bf1d7d315f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.156996 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d12adba8-3a82-4f57-b9c0-c0bf1d7d315f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.157434 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d12adba8-3a82-4f57-b9c0-c0bf1d7d315f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.158296 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d12adba8-3a82-4f57-b9c0-c0bf1d7d315f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.159811 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d12adba8-3a82-4f57-b9c0-c0bf1d7d315f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.184636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d12adba8-3a82-4f57-b9c0-c0bf1d7d315f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Going to try to terminate instance {{(pid=118368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:18:34.486162 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d12adba8-3a82-4f57-b9c0-c0bf1d7d315f tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 204 len: 0 microversion: 2.20 time: 0.339973 Aug 02 09:18:34.486870 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 637/1281] 10.222.0.46 () {60 vars in 1280 bytes} [Tue Aug 2 09:18:34 2022] DELETE /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:18:34.495434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.496033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.504441 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.504886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.505646 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.506183 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.640413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:34.648423 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:34.649960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:34.651121 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-581c548c-e8fc-4de3-bf04-9830e796024e tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.159729 Aug 02 09:18:34.651692 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 645/1282] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:34.689941 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.690558 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.696690 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.697164 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.697955 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.698390 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.711685 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: DELETE /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 HTTP/1.1 Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:18:34.713374 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.715034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'f440de7e-1c06-4efd-aa35-34b3ab64b494'} Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:34.715846 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.717253 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.719043 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:34.719043 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-649d9f6d-283a-4743-b9c5-54dbf8964e14 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 404 len: 111 microversion: 2.1 time: 0.029859 Aug 02 09:18:34.719043 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 638/1283] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:34 2022] DELETE /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:34.723461 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.724123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: f440de7e-1c06-4efd-aa35-34b3ab64b494] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.730137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.730595 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.731362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.731799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.745569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 HTTP/1.1 Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:34.747110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.749277 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'f440de7e-1c06-4efd-aa35-34b3ab64b494'} Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:34.753012 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. Aug 02 09:18:34.754607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.755918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance f440de7e-1c06-4efd-aa35-34b3ab64b494 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:34.755918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d75a30c2-24cf-46a8-b446-982bcd310b5d tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494" status: 404 len: 111 microversion: 2.1 time: 0.028808 Aug 02 09:18:34.755918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 646/1284] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/f440de7e-1c06-4efd-aa35-34b3ab64b494 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:34.757504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.758024 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.764050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.765013 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.765766 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.766227 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.779737 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: DELETE /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 HTTP/1.1 Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:18:34.781801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.783389 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'dbc844d0-e603-4cbd-9196-ef78031daa43'} Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:34.784368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.785803 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.787290 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:34.787290 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-eeda06f6-eb3f-4c9b-ae82-21666c13ece3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 404 len: 111 microversion: 2.1 time: 0.029574 Aug 02 09:18:34.787290 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 639/1285] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:34 2022] DELETE /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:34.791820 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.792431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dbc844d0-e603-4cbd-9196-ef78031daa43] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.798845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.799301 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.800071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.800506 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.813920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 HTTP/1.1 Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:34.815450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.817046 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'dbc844d0-e603-4cbd-9196-ef78031daa43'} Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:34.818167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. Aug 02 09:18:34.819607 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:34.820842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dbc844d0-e603-4cbd-9196-ef78031daa43 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:34.820842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-97e73fa9-3027-4074-8d07-15115be2fce3 tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43" status: 404 len: 111 microversion: 2.1 time: 0.028811 Aug 02 09:18:34.820842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 647/1286] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/dbc844d0-e603-4cbd-9196-ef78031daa43 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:35.675192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:35.675807 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:35.682694 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.683141 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.683914 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.684346 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.819883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:35.828137 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:35.829658 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:35.830934 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cfa9f249-59f0-4801-8362-8d11e53800c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.160420 Aug 02 09:18:35.831496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 640/1287] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:35 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:36.133922 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.134440 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.141992 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.142446 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.143214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.143650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.157601 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e HTTP/1.1 Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:36.159190 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.160846 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'dc22a12f-291a-4c23-add9-09a32ae7202e'} Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:36.161807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.163107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.164753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:36.164753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c89620f3-2533-4322-adac-69aefe33660c tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 404 len: 111 microversion: 2.1 time: 0.030564 Aug 02 09:18:36.164753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 648/1288] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:36 2022] DELETE /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:36.168936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.169578 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] [instance: dc22a12f-291a-4c23-add9-09a32ae7202e] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.175772 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.176240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.176980 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.177414 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.191075 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] HTTP exception thrown: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Request method failure captured: Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e HTTP/1.1 Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkU0HuQA-4nur-CUCvOigIV9moqaSDoQg-BSPGSTAwvooJcFJ-ze_ueUnN0U-ePWnXJqzzNgpjC9gO2EXOdQPg9ti_GOO0I8DiqHGUloIEWOj2Hbr7puCRjphJhEqGZXukJPd8Tq67h2nL_QAV827CeFp1wSkaNPC4YbLvkKbr4VX8 Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:18:36.192504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9df882a572a4bed8966779e50eb7e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: b9df882a572a4bed8966779e50eb7e7c Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-468649417 Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 806f0c03435e4c5daeadaa4eb437d936 Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeNegativeTest-468649417-project Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.194119 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'dc22a12f-291a-4c23-add9-09a32ae7202e'} Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:36.195159 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. Aug 02 09:18:36.196592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:36.198025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] Returning 404 to user: Instance dc22a12f-291a-4c23-add9-09a32ae7202e could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:36.198025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-176f5fe7-748e-4ef7-838b-935d461322fb tempest-AttachVolumeNegativeTest-468649417 tempest-AttachVolumeNegativeTest-468649417-project] 10.222.0.46 "GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e" status: 404 len: 111 microversion: 2.1 time: 0.028780 Aug 02 09:18:36.198025 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 641/1289] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:36 2022] GET /compute/v2.1/servers/dc22a12f-291a-4c23-add9-09a32ae7202e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:18:36.854516 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.855146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.861981 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.862461 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.863226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.863657 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.001859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:37.008535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:37.010076 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:37.011244 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-74005253-9818-41a9-b851-659f9d7864db tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1721 microversion: 2.20 time: 0.160764 Aug 02 09:18:37.011805 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 649/1290] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:36 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:37.779855 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-92badc6e-b3d3-47ad-b0da-82aa83deaeda req-aa5d40df-405f-40ae-8a14-9f3d0dfaa1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea1ac8c-8116-4fed-a2e3-230762ade4b1", "name": "network-vif-deleted", "tag": "7d6ddb74-8337-4c6b-9b6b-fd59368697e0"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:37.794133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-92badc6e-b3d3-47ad-b0da-82aa83deaeda req-aa5d40df-405f-40ae-8a14-9f3d0dfaa1fe service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.794567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-92badc6e-b3d3-47ad-b0da-82aa83deaeda req-aa5d40df-405f-40ae-8a14-9f3d0dfaa1fe service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.799516 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:37.807856 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-92badc6e-b3d3-47ad-b0da-82aa83deaeda req-aa5d40df-405f-40ae-8a14-9f3d0dfaa1fe service nova] Creating event network-vif-deleted:7d6ddb74-8337-4c6b-9b6b-fd59368697e0 for instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 on hv-cinder-84713 Aug 02 09:18:37.815223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-92badc6e-b3d3-47ad-b0da-82aa83deaeda req-aa5d40df-405f-40ae-8a14-9f3d0dfaa1fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038905 Aug 02 09:18:37.816713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 642/1291] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:38.035481 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:38.037059 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:38.050156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.051020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.052131 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.052833 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.135443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:38.153526 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:38.155197 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50918811a90a444eaf123b2aeb4a75b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e47ffad695c4b049ca730c8cc43b9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:38.156404 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4af8551b-195a-4313-9f4c-3013f151ce8d tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 200 len: 1366 microversion: 2.20 time: 0.125600 Aug 02 09:18:38.157132 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 650/1292] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:38 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:39.183380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:39.184122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:39.193139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.193582 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.194563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.195146 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.214038 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] HTTP exception thrown: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Request method failure captured: Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 HTTP/1.1 Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkTPLpEUsgNbyBzzRepXJwyTzIpt23KGHIOF3TWNRBr6QVhTydsDtH3jN3ffxyHqv7m23_TnXP9A1IQb7ivKsmBdB2BgzmNj7TqY2iSa2sL9JUB8GiteHTW26Ezoqy1GLxmP9opmzRyc8ihSe2FPUbTezANdavwBDv2eMhwO3AyK14 Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:18:39.215806 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 50918811a90a444eaf123b2aeb4a75b3 Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:39.217285 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'dea1ac8c-8116-4fed-a2e3-230762ade4b1'} Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:39.222219 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:39.223826 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:39.225254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Returning 404 to user: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:39.225254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2b5ab7df-5e94-4f25-9528-2096a437c2c2 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 404 len: 111 microversion: 2.20 time: 0.040426 Aug 02 09:18:39.225254 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 643/1293] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:39 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:18:39.227232 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b3e85c96-2be9-4a48-bf54-6fccb32dd0d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '.version_select at 0x7f0f31f0caf0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:39.327521 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b3e85c96-2be9-4a48-bf54-6fccb32dd0d6 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097893628" status: 204 len: 0 microversion: 2.20 time: 0.104421 Aug 02 09:18:39.328582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 651/1294] 10.222.0.46 () {60 vars in 1262 bytes} [Tue Aug 2 09:18:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097893628 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:18:41.465398 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:41.466470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:41.473761 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.474243 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.475015 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.475449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.490311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] HTTP exception thrown: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Request method failure captured: Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: DELETE /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 HTTP/1.1 Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OkTPLpEUsgNbyBzzRepXJwyTzIpt23KGHIOF3TWNRBr6QVhTydsDtH3jN3ffxyHqv7m23_TnXP9A1IQb7ivKsmBdB2BgzmNj7TqY2iSa2sL9JUB8GiteHTW26Ezoqy1GLxmP9opmzRyc8ihSe2FPUbTezANdavwBDv2eMhwO3AyK14 Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:18:41.491865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 50918811a90a444eaf123b2aeb4a75b3 Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.493428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'dea1ac8c-8116-4fed-a2e3-230762ade4b1'} Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:41.494206 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.495529 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.496773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Returning 404 to user: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:41.496773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-153b8447-2157-497b-8f76-7dd2163c402b tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 404 len: 111 microversion: 2.20 time: 0.031787 Aug 02 09:18:41.496773 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 644/1295] 10.222.0.46 () {60 vars in 1280 bytes} [Tue Aug 2 09:18:41 2022] DELETE /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:18:41.503365 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:41.503976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: dea1ac8c-8116-4fed-a2e3-230762ade4b1] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:41.510058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.510515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.511285 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.511721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.525210 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] HTTP exception thrown: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Request method failure captured: Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 HTTP/1.1 Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkTPLpEUsgNbyBzzRepXJwyTzIpt23KGHIOF3TWNRBr6QVhTydsDtH3jN3ffxyHqv7m23_TnXP9A1IQb7ivKsmBdB2BgzmNj7TqY2iSa2sL9JUB8GiteHTW26Ezoqy1GLxmP9opmzRyc8ihSe2FPUbTezANdavwBDv2eMhwO3AyK14 Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:41.526785 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 50918811a90a444eaf123b2aeb4a75b3 Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.528460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'dea1ac8c-8116-4fed-a2e3-230762ade4b1'} Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:41.529242 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. Aug 02 09:18:41.530578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:41.531650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Returning 404 to user: Instance dea1ac8c-8116-4fed-a2e3-230762ade4b1 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:41.531650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-62da3877-4e40-4d1b-8b6e-8e52d82423f7 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1" status: 404 len: 111 microversion: 2.20 time: 0.030020 Aug 02 09:18:41.531650 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 652/1296] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:41 2022] GET /compute/v2.1/servers/dea1ac8c-8116-4fed-a2e3-230762ade4b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:18:42.661951 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d32253f9-ed52-4617-8226-cac8768865e5 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Action: 'create', calling method: .version_select at 0x7f0f2d5fd940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1579177080", "metadata": {"Type": "work"}}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:42.785699 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:42.786896 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:42.793147 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.793694 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.794569 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.795044 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.808799 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] HTTP exception thrown: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Request method failure captured: Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 HTTP/1.1 Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkTPLpEUsgNbyBzzRepXJwyTzIpt23KGHIOF3TWNRBr6QVhTydsDtH3jN3ffxyHqv7m23_TnXP9A1IQb7ivKsmBdB2BgzmNj7TqY2iSa2sL9JUB8GiteHTW26Ezoqy1GLxmP9opmzRyc8ihSe2FPUbTezANdavwBDv2eMhwO3AyK14 Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:42.814522 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 50918811a90a444eaf123b2aeb4a75b3 Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.816200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '6c248147-71ed-4f5f-89cc-8ca12974efb4'} Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:42.817119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.818663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.820145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Returning 404 to user: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:42.820145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1811db9d-0a58-4eed-8e57-e2f6f498a3f9 tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 404 len: 111 microversion: 2.20 time: 0.032284 Aug 02 09:18:42.820145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 653/1297] 10.222.0.46 () {60 vars in 1280 bytes} [Tue Aug 2 09:18:42 2022] DELETE /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:18:42.825402 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:42.826166 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] [instance: 6c248147-71ed-4f5f-89cc-8ca12974efb4] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:42.832858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.833305 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.834100 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.834536 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.849430 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] HTTP exception thrown: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Request method failure captured: Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 HTTP/1.1 Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OkTPLpEUsgNbyBzzRepXJwyTzIpt23KGHIOF3TWNRBr6QVhTydsDtH3jN3ffxyHqv7m23_TnXP9A1IQb7ivKsmBdB2BgzmNj7TqY2iSa2sL9JUB8GiteHTW26Ezoqy1GLxmP9opmzRyc8ihSe2FPUbTezANdavwBDv2eMhwO3AyK14 Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:42.850975 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e47ffad695c4b049ca730c8cc43b9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 7e47ffad695c4b049ca730c8cc43b9f9 Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1412278851 Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 50918811a90a444eaf123b2aeb4a75b3 Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1412278851-project Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.852682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '6c248147-71ed-4f5f-89cc-8ca12974efb4'} Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:42.853600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. Aug 02 09:18:42.855160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:42.856467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] Returning 404 to user: Instance 6c248147-71ed-4f5f-89cc-8ca12974efb4 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:42.856467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4c76e876-1218-424e-9918-d6bacbe6a1ba tempest-AttachVolumeShelveTestJSON-1412278851 tempest-AttachVolumeShelveTestJSON-1412278851-project] 10.222.0.46 "GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4" status: 404 len: 111 microversion: 2.20 time: 0.030763 Aug 02 09:18:42.856467 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 654/1298] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:42 2022] GET /compute/v2.1/servers/6c248147-71ed-4f5f-89cc-8ca12974efb4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:18:43.241987 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d32253f9-ed52-4617-8226-cac8768865e5 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.696630 Aug 02 09:18:43.242639 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 645/1299] 10.222.0.46 () {60 vars in 1156 bytes} [Tue Aug 2 09:18:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 698 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 09:18:43.255817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-af0e5205-ec8c-4070-b019-84736a27c2b5 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Calling method '.version_select at 0x7f0f2d55c820>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:43.304908 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-af0e5205-ec8c-4070-b019-84736a27c2b5 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4" status: 200 len: 353 microversion: 2.1 time: 0.052917 Aug 02 09:18:43.305484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 655/1300] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:43 2022] GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:44.319756 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-07726bf5-9f3d-4668-8a85-c3cb002d8f55 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Calling method '.version_select at 0x7f0f2d99c310>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:44.369615 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-07726bf5-9f3d-4668-8a85-c3cb002d8f55 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4" status: 200 len: 353 microversion: 2.1 time: 0.054151 Aug 02 09:18:44.370313 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 646/1301] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:44 2022] GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:45.384096 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-91b305b2-1538-47f3-a92b-461794d9c634 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Calling method '.version_select at 0x7f0f2d61cdc0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.446502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-91b305b2-1538-47f3-a92b-461794d9c634 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4" status: 200 len: 354 microversion: 2.1 time: 0.067221 Aug 02 09:18:45.447071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 656/1302] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:45 2022] GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4 => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:45.466250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ff885b9d-b9c3-4cb3-8b95-f02f67be919e tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Calling method '.version_select at 0x7f0f2d98e160>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.524467 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ff885b9d-b9c3-4cb3-8b95-f02f67be919e tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4" status: 200 len: 354 microversion: 2.1 time: 0.063449 Aug 02 09:18:45.525040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 647/1303] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:45 2022] GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4 => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:45.538632 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4e0ca2f5-fc0b-4639-89bc-36002d26ea7f tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Calling method '.version_select at 0x7f0f2d5651f0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.778294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4e0ca2f5-fc0b-4639-89bc-36002d26ea7f tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4" status: 202 len: 0 microversion: 2.1 time: 0.243380 Aug 02 09:18:45.782454 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 657/1304] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:18:45 2022] DELETE /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:45.787329 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-abeeb8bb-1028-42d5-9788-7c6f3e2edaac tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Calling method '.version_select at 0x7f0f2d830280>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.852493 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-abeeb8bb-1028-42d5-9788-7c6f3e2edaac tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4" status: 200 len: 353 microversion: 2.1 time: 0.068899 Aug 02 09:18:45.853196 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 648/1305] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:45 2022] GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:46.867305 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d9d131e3-3772-4c38-989d-1313c9b49689 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Calling method '.version_select at 0x7f0f2d6001f0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:46.896696 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-d9d131e3-3772-4c38-989d-1313c9b49689 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] HTTP exception thrown: Volume b0aaf8d6-69ca-44b8-a181-4d664c226cb4 could not be found. Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d9d131e3-3772-4c38-989d-1313c9b49689 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Request method failure captured: Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4 HTTP/1.1 Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OvyPwotB9uJXwY5WKdsb963glkFAZ1bET1sFDzzpRaa-F7bxw0bwIL70VqQ1OuOR5DH5-uVcPU8gwK5F4xpfVl_rgDkW3Ev6kOn2OnGt3EWGNgkgOpxCUjYAFtkxd4hRaSjCZxeNOM4u3fWvNRkzpRNAbxEpnriX8fW0wO5BMNapjM Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 8b77eb0762b346d08d74fcffcb3b3550 Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-VolumesGetTestJSON-1526677076 Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:18:46.899021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8b77eb0762b346d08d74fcffcb3b3550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8b77eb0762b346d08d74fcffcb3b3550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8b77eb0762b346d08d74fcffcb3b3550"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8b77eb0762b346d08d74fcffcb3b3550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-VolumesGetTestJSON-1526677076 Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 8b77eb0762b346d08d74fcffcb3b3550 Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-VolumesGetTestJSON-1526677076 Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-VolumesGetTestJSON-1526677076-project Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 6041d1b8a0434f599dc77d13ff862ddb Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-VolumesGetTestJSON-1526677076-project Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Volume b0aaf8d6-69ca-44b8-a181-4d664c226cb4 could not be found. Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'b0aaf8d6-69ca-44b8-a181-4d664c226cb4'} Aug 02 09:18:46.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0aaf8d6-69ca-44b8-a181-4d664c226cb4 could not be found. (HTTP 404) (Request-ID: req-e463840c-4c90-458d-a90e-05c1315fc63d) Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:46.901678 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:18:46.903317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0aaf8d6-69ca-44b8-a181-4d664c226cb4 could not be found. Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:18:46.905257 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0aaf8d6-69ca-44b8-a181-4d664c226cb4 could not be found. Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0aaf8d6-69ca-44b8-a181-4d664c226cb4 could not be found. Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d9d131e3-3772-4c38-989d-1313c9b49689 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] Returning 404 to user: Volume b0aaf8d6-69ca-44b8-a181-4d664c226cb4 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d9d131e3-3772-4c38-989d-1313c9b49689 tempest-VolumesGetTestJSON-1526677076 tempest-VolumesGetTestJSON-1526677076-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4" status: 404 len: 109 microversion: 2.1 time: 0.037718 Aug 02 09:18:46.906779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 658/1306] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:46 2022] GET /compute/v2.1/os-volumes/b0aaf8d6-69ca-44b8-a181-4d664c226cb4 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:52.060286 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:52.064196 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-526267d6-4305-47c4-a8c8-94740469be2d tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f2d6b8ee0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:52.111215 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-526267d6-4305-47c4-a8c8-94740469be2d tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ef536679-3384-4d01-82e9-9122819112aa" status: 200 len: 350 microversion: 2.1 time: 0.052293 Aug 02 09:18:52.111818 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 649/1307] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:52 2022] GET /compute/v2.1/os-volumes/ef536679-3384-4d01-82e9-9122819112aa => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:54.843949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:54.844710 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=41 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:54.848472 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-02ba390e-db8b-425a-8d99-81b8af86e78a tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f31eace50>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:54.898508 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-02ba390e-db8b-425a-8d99-81b8af86e78a tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/20220e32-d8ce-42e2-bed7-7b7bd859eec5" status: 200 len: 350 microversion: 2.1 time: 0.055761 Aug 02 09:18:54.899082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 659/1308] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:54 2022] GET /compute/v2.1/os-volumes/20220e32-d8ce-42e2-bed7-7b7bd859eec5 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:57.621086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=4 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:57.630720 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-20fa4ccc-75eb-49ab-8b66-3794acd9e804 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f2da1f3a0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.676297 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-20fa4ccc-75eb-49ab-8b66-3794acd9e804 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/a5079bbb-c944-4c4b-94ac-cf21ac0c38f9" status: 200 len: 351 microversion: 2.1 time: 0.055800 Aug 02 09:18:57.680929 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 650/1309] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/os-volumes/a5079bbb-c944-4c4b-94ac-cf21ac0c38f9 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:57.691396 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c647c068-aa0c-445f-8ba5-d9da04eba90d tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f2d600dc0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.772982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c647c068-aa0c-445f-8ba5-d9da04eba90d tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086644 Aug 02 09:18:57.773539 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 660/1310] 10.222.0.46 () {58 vars in 1134 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:57.786945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-31fa7893-67a1-45f5-be60-407df9757fd2 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f2d80d4c0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.871278 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-31fa7893-67a1-45f5-be60-407df9757fd2 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088039 Aug 02 09:18:57.872005 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 651/1311] 10.222.0.46 () {58 vars in 1149 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:57.886085 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f21fe855-40e9-4edf-9329-3dd794ffb61e tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f2d66bc10>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.973387 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f21fe855-40e9-4edf-9329-3dd794ffb61e tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091501 Aug 02 09:18:57.973982 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 661/1312] 10.222.0.46 () {58 vars in 1134 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:57.987329 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-ecc00d75-f532-4b25-b172-354f40f30067 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f2da9ed30>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.073351 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-ecc00d75-f532-4b25-b172-354f40f30067 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090014 Aug 02 09:18:58.073937 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 652/1313] 10.222.0.46 () {58 vars in 1167 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:58.087325 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7d838c08-a723-4fc4-8ed6-77b3f947480b tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f31f0cca0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.170034 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7d838c08-a723-4fc4-8ed6-77b3f947480b tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086196 Aug 02 09:18:58.170610 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 662/1314] 10.222.0.46 () {58 vars in 1170 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:58.187425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-774eb583-292c-49f1-9f6d-d0432a1ff8f4 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f2d836430>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.268318 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-774eb583-292c-49f1-9f6d-d0432a1ff8f4 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087756 Aug 02 09:18:58.268895 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 653/1315] 10.222.0.46 () {58 vars in 1155 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:58.281966 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b4c9ea2c-e26d-42ad-ab1b-3397f52c52ee tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f31efa1f0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.364169 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b4c9ea2c-e26d-42ad-ab1b-3397f52c52ee tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086449 Aug 02 09:18:58.364734 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 663/1316] 10.222.0.46 () {58 vars in 1188 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:58.377829 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-cfc50bcf-e6dd-46bb-9fd8-7cb34a851be9 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] Calling method '.version_select at 0x7f0f31ec9ca0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.462553 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-cfc50bcf-e6dd-46bb-9fd8-7cb34a851be9 tempest-VolumesTestJSON-240863241 tempest-VolumesTestJSON-240863241-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088373 Aug 02 09:18:58.463179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 654/1317] 10.222.0.46 () {58 vars in 1155 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:17.026109 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5272ed75-8f5f-4ab6-b0ca-29e75b93eeb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:17.026691 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5272ed75-8f5f-4ab6-b0ca-29e75b93eeb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:17.033625 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5272ed75-8f5f-4ab6-b0ca-29e75b93eeb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.034110 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5272ed75-8f5f-4ab6-b0ca-29e75b93eeb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.035056 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5272ed75-8f5f-4ab6-b0ca-29e75b93eeb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.035489 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5272ed75-8f5f-4ab6-b0ca-29e75b93eeb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.116123 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-5272ed75-8f5f-4ab6-b0ca-29e75b93eeb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lazy-loading 'services' on Instance uuid e04e0dc0-229f-4f7e-a56b-582dcc6b64fd {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:19:17.369026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5272ed75-8f5f-4ab6-b0ca-29e75b93eeb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/os-volume_attachments/2a11ca15-0294-4e58-ba2c-aa9f59ed4ba5" status: 202 len: 0 microversion: 2.1 time: 0.343575 Aug 02 09:19:17.369026 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 664/1318] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:19:17 2022] DELETE /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/os-volume_attachments/2a11ca15-0294-4e58-ba2c-aa9f59ed4ba5 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:19:19.629504 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-10ed2511-7684-438e-9c40-18c4a3fb4eb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:19.636281 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10ed2511-7684-438e-9c40-18c4a3fb4eb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.637492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-10ed2511-7684-438e-9c40-18c4a3fb4eb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:19.662790 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-10ed2511-7684-438e-9c40-18c4a3fb4eb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Going to try to stop instance {{(pid=118368) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 09:19:19.863966 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-10ed2511-7684-438e-9c40-18c4a3fb4eb8 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/action" status: 202 len: 0 microversion: 2.1 time: 0.239586 Aug 02 09:19:19.864770 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 655/1319] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:19:19 2022] POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:19:19.879020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-bb48af4b-ab0b-4a46-a5c0-a16b3121de21 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:19.880296 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-bb48af4b-ab0b-4a46-a5c0-a16b3121de21 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:19.891741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bb48af4b-ab0b-4a46-a5c0-a16b3121de21 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.893221 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bb48af4b-ab0b-4a46-a5c0-a16b3121de21 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:19.893750 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bb48af4b-ab0b-4a46-a5c0-a16b3121de21 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.894514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-bb48af4b-ab0b-4a46-a5c0-a16b3121de21 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.055010 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-bb48af4b-ab0b-4a46-a5c0-a16b3121de21 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:20.064263 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-bb48af4b-ab0b-4a46-a5c0-a16b3121de21 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.194087 Aug 02 09:19:20.064853 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 665/1320] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:19 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:21.085736 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d7c93416-916b-43f5-8b81-f64c540c1a74 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:21.086465 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d7c93416-916b-43f5-8b81-f64c540c1a74 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:21.093179 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d7c93416-916b-43f5-8b81-f64c540c1a74 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.093632 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d7c93416-916b-43f5-8b81-f64c540c1a74 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.094430 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d7c93416-916b-43f5-8b81-f64c540c1a74 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.094866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d7c93416-916b-43f5-8b81-f64c540c1a74 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.230208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-d7c93416-916b-43f5-8b81-f64c540c1a74 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:21.237935 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d7c93416-916b-43f5-8b81-f64c540c1a74 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.157000 Aug 02 09:19:21.238513 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 656/1321] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:21 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:22.261375 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-7e23d0c7-5211-4adc-add1-8f946c965bd5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:22.262068 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-7e23d0c7-5211-4adc-add1-8f946c965bd5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:22.268740 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e23d0c7-5211-4adc-add1-8f946c965bd5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.269193 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e23d0c7-5211-4adc-add1-8f946c965bd5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.269990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e23d0c7-5211-4adc-add1-8f946c965bd5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.270433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-7e23d0c7-5211-4adc-add1-8f946c965bd5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.412038 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-7e23d0c7-5211-4adc-add1-8f946c965bd5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:22.420218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-7e23d0c7-5211-4adc-add1-8f946c965bd5 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.162829 Aug 02 09:19:22.424476 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 666/1322] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:22 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:23.442099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0a2e79bc-fb3b-4f06-8143-7526de1204bc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:23.442713 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0a2e79bc-fb3b-4f06-8143-7526de1204bc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:23.450218 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a2e79bc-fb3b-4f06-8143-7526de1204bc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.450668 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a2e79bc-fb3b-4f06-8143-7526de1204bc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.451437 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a2e79bc-fb3b-4f06-8143-7526de1204bc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.451915 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a2e79bc-fb3b-4f06-8143-7526de1204bc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.593492 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0a2e79bc-fb3b-4f06-8143-7526de1204bc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:23.601292 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0a2e79bc-fb3b-4f06-8143-7526de1204bc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.162909 Aug 02 09:19:23.601623 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 657/1323] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:23 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:24.622673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6c43a7cd-b25f-4733-a19d-dcaa1f80f956 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:24.623327 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6c43a7cd-b25f-4733-a19d-dcaa1f80f956 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:24.629794 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c43a7cd-b25f-4733-a19d-dcaa1f80f956 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.630364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c43a7cd-b25f-4733-a19d-dcaa1f80f956 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.631161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c43a7cd-b25f-4733-a19d-dcaa1f80f956 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.631592 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6c43a7cd-b25f-4733-a19d-dcaa1f80f956 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.770901 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-6c43a7cd-b25f-4733-a19d-dcaa1f80f956 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:24.778821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6c43a7cd-b25f-4733-a19d-dcaa1f80f956 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.159956 Aug 02 09:19:24.779389 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 667/1324] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:24 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:25.799727 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c1e7d73e-2815-4ff4-90dc-293c3d19cfe1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:25.804436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c1e7d73e-2815-4ff4-90dc-293c3d19cfe1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:25.807271 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c1e7d73e-2815-4ff4-90dc-293c3d19cfe1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.807723 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c1e7d73e-2815-4ff4-90dc-293c3d19cfe1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.809381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c1e7d73e-2815-4ff4-90dc-293c3d19cfe1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.810208 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c1e7d73e-2815-4ff4-90dc-293c3d19cfe1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.961721 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c1e7d73e-2815-4ff4-90dc-293c3d19cfe1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:25.969910 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c1e7d73e-2815-4ff4-90dc-293c3d19cfe1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.173854 Aug 02 09:19:25.973333 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 658/1325] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:25 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:26.991872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f61ad1d6-48b7-4cfc-afc9-09fdecd30a06 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:26.992421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f61ad1d6-48b7-4cfc-afc9-09fdecd30a06 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:26.999640 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f61ad1d6-48b7-4cfc-afc9-09fdecd30a06 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.000092 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f61ad1d6-48b7-4cfc-afc9-09fdecd30a06 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.000860 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f61ad1d6-48b7-4cfc-afc9-09fdecd30a06 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.001316 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f61ad1d6-48b7-4cfc-afc9-09fdecd30a06 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.178388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f61ad1d6-48b7-4cfc-afc9-09fdecd30a06 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:27.186903 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f61ad1d6-48b7-4cfc-afc9-09fdecd30a06 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.199008 Aug 02 09:19:27.187496 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 668/1326] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:26 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:28.213300 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2f281b10-ac33-4d3f-b597-c23c44735bc3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:28.213300 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2f281b10-ac33-4d3f-b597-c23c44735bc3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:28.219086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2f281b10-ac33-4d3f-b597-c23c44735bc3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.219544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2f281b10-ac33-4d3f-b597-c23c44735bc3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.220311 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2f281b10-ac33-4d3f-b597-c23c44735bc3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.220769 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2f281b10-ac33-4d3f-b597-c23c44735bc3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.356732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2f281b10-ac33-4d3f-b597-c23c44735bc3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:28.365075 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2f281b10-ac33-4d3f-b597-c23c44735bc3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.157651 Aug 02 09:19:28.365649 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 659/1327] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:28 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:29.386995 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-896bb5e0-7289-4d74-848e-154edc864791 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:29.396228 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-896bb5e0-7289-4d74-848e-154edc864791 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:29.396228 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-896bb5e0-7289-4d74-848e-154edc864791 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.396228 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-896bb5e0-7289-4d74-848e-154edc864791 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.396582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-896bb5e0-7289-4d74-848e-154edc864791 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.396688 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-896bb5e0-7289-4d74-848e-154edc864791 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.544436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-896bb5e0-7289-4d74-848e-154edc864791 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:29.552159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-896bb5e0-7289-4d74-848e-154edc864791 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1678 microversion: 2.1 time: 0.169384 Aug 02 09:19:29.552737 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 669/1328] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:29 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:30.577142 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-224b3a80-6cc8-41f8-bec9-b511ca57cf31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:30.578752 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-224b3a80-6cc8-41f8-bec9-b511ca57cf31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:30.584912 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-224b3a80-6cc8-41f8-bec9-b511ca57cf31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.585368 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-224b3a80-6cc8-41f8-bec9-b511ca57cf31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.586173 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-224b3a80-6cc8-41f8-bec9-b511ca57cf31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.586606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-224b3a80-6cc8-41f8-bec9-b511ca57cf31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.760184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-224b3a80-6cc8-41f8-bec9-b511ca57cf31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:30.767872 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-224b3a80-6cc8-41f8-bec9-b511ca57cf31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1655 microversion: 2.1 time: 0.194631 Aug 02 09:19:30.768449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 660/1329] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:30 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1655 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:30.789472 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c707fd05-e088-4db3-bc71-0f10fc427e4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:30.796912 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c707fd05-e088-4db3-bc71-0f10fc427e4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.797364 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c707fd05-e088-4db3-bc71-0f10fc427e4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.820847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c707fd05-e088-4db3-bc71-0f10fc427e4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Going to try to start instance {{(pid=118366) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 09:19:31.001677 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c707fd05-e088-4db3-bc71-0f10fc427e4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/action" status: 202 len: 0 microversion: 2.1 time: 0.215921 Aug 02 09:19:31.002452 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 670/1330] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 2 09:19:30 2022] POST /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:19:31.011479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a6a7ec9e-c20e-458e-ba26-15f541dc3274 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:31.012331 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a6a7ec9e-c20e-458e-ba26-15f541dc3274 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:31.020033 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6a7ec9e-c20e-458e-ba26-15f541dc3274 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.020575 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6a7ec9e-c20e-458e-ba26-15f541dc3274 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.021422 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6a7ec9e-c20e-458e-ba26-15f541dc3274 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.021865 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a6a7ec9e-c20e-458e-ba26-15f541dc3274 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.156878 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a6a7ec9e-c20e-458e-ba26-15f541dc3274 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:31.165731 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a6a7ec9e-c20e-458e-ba26-15f541dc3274 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1664 microversion: 2.1 time: 0.158837 Aug 02 09:19:31.166342 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 661/1331] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:31 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:32.191789 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-05547c04-7a85-425d-a48a-5c322e59fbde tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:32.192515 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-05547c04-7a85-425d-a48a-5c322e59fbde tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:32.198868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05547c04-7a85-425d-a48a-5c322e59fbde tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.199319 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05547c04-7a85-425d-a48a-5c322e59fbde tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.200120 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05547c04-7a85-425d-a48a-5c322e59fbde tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.200534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-05547c04-7a85-425d-a48a-5c322e59fbde tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.335200 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-05547c04-7a85-425d-a48a-5c322e59fbde tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:32.344125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-05547c04-7a85-425d-a48a-5c322e59fbde tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1664 microversion: 2.1 time: 0.156932 Aug 02 09:19:32.344903 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 671/1332] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:32 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:33.366575 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-bddb6459-2ba4-4d99-bb8b-ce8d2cddea39 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:33.367200 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-bddb6459-2ba4-4d99-bb8b-ce8d2cddea39 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:33.373730 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bddb6459-2ba4-4d99-bb8b-ce8d2cddea39 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.374275 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bddb6459-2ba4-4d99-bb8b-ce8d2cddea39 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.375049 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bddb6459-2ba4-4d99-bb8b-ce8d2cddea39 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.375489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-bddb6459-2ba4-4d99-bb8b-ce8d2cddea39 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.543711 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-bddb6459-2ba4-4d99-bb8b-ce8d2cddea39 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:33.552190 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-bddb6459-2ba4-4d99-bb8b-ce8d2cddea39 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1668 microversion: 2.1 time: 0.189486 Aug 02 09:19:33.553109 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 662/1333] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:33 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:51.884041 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:19:51.885573 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:19:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:19:52.404020 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1952499708", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-950545340", "security_groups": [{"name": "tempest-secgroup-smoke-1305715777"}], "block_device_mapping_v2": [{"uuid": "277fc162-8670-48ac-9adb-1b45403a8c6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "341e5912-5743-40e5-8ad1-cb9e084387ea"}]}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:52.414400 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=16 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:52.415144 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:52.523627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] validate_networks() for [('341e5912-5743-40e5-8ad1-cb9e084387ea', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:19:53.060238 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:19:53.060798 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:19:53.061289 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:19:53.061723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:19:53.062159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:19:53.071745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.072191 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.073603 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.074058 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.094964 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Getting quotas for project d65888d17d2e439592600a4e9305eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:19:53.100493 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Getting quotas for user 02569c995a6d4b678933599f60ad3909 and project d65888d17d2e439592600a4e9305eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:19:53.163826 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:19:53.166024 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='277fc162-8670-48ac-9adb-1b45403a8c6a',volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:19:53.523860 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-822ed6d7-078f-4544-9d69-2b75403a6ba6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.124370 Aug 02 09:19:53.524550 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 672/1334] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:19:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:19:53.543581 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2cfff83e-b76f-4e4c-bb7d-23f734b43539 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:53.544684 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2cfff83e-b76f-4e4c-bb7d-23f734b43539 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:53.548875 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=16 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:53.550405 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:53.604496 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2cfff83e-b76f-4e4c-bb7d-23f734b43539 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:53.612060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2cfff83e-b76f-4e4c-bb7d-23f734b43539 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1094 microversion: 2.1 time: 0.076176 Aug 02 09:19:53.612637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 663/1335] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:53 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:54.633864 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-1f31a0c0-3500-4131-8c67-44999d289075 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:54.634534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-1f31a0c0-3500-4131-8c67-44999d289075 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:54.694214 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-1f31a0c0-3500-4131-8c67-44999d289075 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:54.702064 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-1f31a0c0-3500-4131-8c67-44999d289075 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1094 microversion: 2.1 time: 0.072596 Aug 02 09:19:54.702639 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 673/1336] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:54 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:55.726907 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b0486663-f972-42db-9c1a-dbcce3a08d66 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:55.727521 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b0486663-f972-42db-9c1a-dbcce3a08d66 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:55.782884 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-b0486663-f972-42db-9c1a-dbcce3a08d66 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:55.790088 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b0486663-f972-42db-9c1a-dbcce3a08d66 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1094 microversion: 2.1 time: 0.067037 Aug 02 09:19:55.790654 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 664/1337] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:55 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:56.811213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-789b853f-cfba-4f32-8255-9a6a9940eee6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:56.811861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-789b853f-cfba-4f32-8255-9a6a9940eee6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:56.863380 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-789b853f-cfba-4f32-8255-9a6a9940eee6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:56.870873 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-789b853f-cfba-4f32-8255-9a6a9940eee6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1094 microversion: 2.1 time: 0.063511 Aug 02 09:19:56.871443 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 674/1338] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:56 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:57.892227 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-32ba11f7-2b85-46d3-a42d-a6c0cd63266b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:57.892839 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-32ba11f7-2b85-46d3-a42d-a6c0cd63266b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:57.899447 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-32ba11f7-2b85-46d3-a42d-a6c0cd63266b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.899894 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-32ba11f7-2b85-46d3-a42d-a6c0cd63266b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.900671 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-32ba11f7-2b85-46d3-a42d-a6c0cd63266b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.901105 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-32ba11f7-2b85-46d3-a42d-a6c0cd63266b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.966680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-32ba11f7-2b85-46d3-a42d-a6c0cd63266b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:57.974457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-32ba11f7-2b85-46d3-a42d-a6c0cd63266b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1144 microversion: 2.1 time: 0.086339 Aug 02 09:19:57.975038 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 665/1339] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:57 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:58.997044 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a137feb4-93fd-45bf-ad17-439fec5c8256 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:58.997661 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a137feb4-93fd-45bf-ad17-439fec5c8256 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:59.005008 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a137feb4-93fd-45bf-ad17-439fec5c8256 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.005463 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a137feb4-93fd-45bf-ad17-439fec5c8256 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.007350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a137feb4-93fd-45bf-ad17-439fec5c8256 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.007350 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a137feb4-93fd-45bf-ad17-439fec5c8256 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.070742 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a137feb4-93fd-45bf-ad17-439fec5c8256 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:59.078279 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a137feb4-93fd-45bf-ad17-439fec5c8256 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1192 microversion: 2.1 time: 0.085639 Aug 02 09:19:59.078849 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 675/1340] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:58 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:00.100385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7ede9662-18e9-4a99-9a72-982497d87887 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:00.100989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7ede9662-18e9-4a99-9a72-982497d87887 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:00.112220 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ede9662-18e9-4a99-9a72-982497d87887 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.113603 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ede9662-18e9-4a99-9a72-982497d87887 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.113603 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ede9662-18e9-4a99-9a72-982497d87887 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.113983 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7ede9662-18e9-4a99-9a72-982497d87887 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.196144 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-7ede9662-18e9-4a99-9a72-982497d87887 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:00.204247 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7ede9662-18e9-4a99-9a72-982497d87887 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1210 microversion: 2.1 time: 0.107783 Aug 02 09:20:00.204836 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 666/1341] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:00 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:01.230854 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-37dd0f16-a876-4b05-a77a-55abc676d0b5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:01.231492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-37dd0f16-a876-4b05-a77a-55abc676d0b5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:01.238145 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37dd0f16-a876-4b05-a77a-55abc676d0b5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.238599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37dd0f16-a876-4b05-a77a-55abc676d0b5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.239377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37dd0f16-a876-4b05-a77a-55abc676d0b5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.239815 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37dd0f16-a876-4b05-a77a-55abc676d0b5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.372148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-37dd0f16-a876-4b05-a77a-55abc676d0b5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:01.379715 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-37dd0f16-a876-4b05-a77a-55abc676d0b5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1278 microversion: 2.1 time: 0.153207 Aug 02 09:20:01.380284 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 676/1342] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:01 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:02.399494 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3d024615-e92f-4551-9e2e-4d71146fadde tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:02.405497 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3d024615-e92f-4551-9e2e-4d71146fadde tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:02.406724 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d024615-e92f-4551-9e2e-4d71146fadde tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.407173 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d024615-e92f-4551-9e2e-4d71146fadde tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.407941 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d024615-e92f-4551-9e2e-4d71146fadde tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.408373 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3d024615-e92f-4551-9e2e-4d71146fadde tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.545451 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3d024615-e92f-4551-9e2e-4d71146fadde tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:02.552963 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3d024615-e92f-4551-9e2e-4d71146fadde tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1278 microversion: 2.1 time: 0.157461 Aug 02 09:20:02.553536 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 667/1343] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:02 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:03.454534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-545e7ef1-dd7c-409b-99ac-1692037e9d39 req-b7b7e4e2-54c3-410e-a666-631d42da8f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f0a27d-cdc0-4355-a295-edf59d4ffa05", "tag": "e79c2678-5fc2-4bdf-9965-eade0f761a7e"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:03.459813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:03.465787 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-545e7ef1-dd7c-409b-99ac-1692037e9d39 req-b7b7e4e2-54c3-410e-a666-631d42da8f84 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.466260 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-545e7ef1-dd7c-409b-99ac-1692037e9d39 req-b7b7e4e2-54c3-410e-a666-631d42da8f84 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.477101 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-545e7ef1-dd7c-409b-99ac-1692037e9d39 req-b7b7e4e2-54c3-410e-a666-631d42da8f84 service nova] Creating event network-changed:e79c2678-5fc2-4bdf-9965-eade0f761a7e for instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 on hv-cinder-84713 Aug 02 09:20:03.483112 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-545e7ef1-dd7c-409b-99ac-1692037e9d39 req-b7b7e4e2-54c3-410e-a666-631d42da8f84 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032272 Aug 02 09:20:03.483729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 677/1344] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:03.575853 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3b0c01e6-6e32-4e56-8e73-087846c07a8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:03.576429 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3b0c01e6-6e32-4e56-8e73-087846c07a8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:03.583051 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3b0c01e6-6e32-4e56-8e73-087846c07a8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.583499 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3b0c01e6-6e32-4e56-8e73-087846c07a8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.584291 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3b0c01e6-6e32-4e56-8e73-087846c07a8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.584726 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3b0c01e6-6e32-4e56-8e73-087846c07a8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.722343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3b0c01e6-6e32-4e56-8e73-087846c07a8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:03.730395 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3b0c01e6-6e32-4e56-8e73-087846c07a8f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1278 microversion: 2.1 time: 0.159318 Aug 02 09:20:03.730981 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 668/1345] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:03 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:04.753478 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-454873f2-5577-42c1-b56f-030c6cef45ac tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:04.754274 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-454873f2-5577-42c1-b56f-030c6cef45ac tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:04.761587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-454873f2-5577-42c1-b56f-030c6cef45ac tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.762114 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-454873f2-5577-42c1-b56f-030c6cef45ac tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.762895 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-454873f2-5577-42c1-b56f-030c6cef45ac tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.763336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-454873f2-5577-42c1-b56f-030c6cef45ac tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.902421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-454873f2-5577-42c1-b56f-030c6cef45ac tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:04.910562 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-454873f2-5577-42c1-b56f-030c6cef45ac tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1278 microversion: 2.1 time: 0.161823 Aug 02 09:20:04.911148 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 678/1346] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:04 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:05.932712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-c9214423-ad5a-4b28-8f8e-df23c2953059 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:05.933326 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-c9214423-ad5a-4b28-8f8e-df23c2953059 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:05.935963 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=4 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:05.941945 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c9214423-ad5a-4b28-8f8e-df23c2953059 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.942398 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c9214423-ad5a-4b28-8f8e-df23c2953059 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.943169 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c9214423-ad5a-4b28-8f8e-df23c2953059 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.943622 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-c9214423-ad5a-4b28-8f8e-df23c2953059 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.090276 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-c9214423-ad5a-4b28-8f8e-df23c2953059 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:06.097563 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-c9214423-ad5a-4b28-8f8e-df23c2953059 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.169514 Aug 02 09:20:06.098149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 669/1347] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:05 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:07.119823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-37273f8c-3494-4877-8ee5-3856fc3772d8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:07.120450 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-37273f8c-3494-4877-8ee5-3856fc3772d8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:07.122859 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=10 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:07.127633 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37273f8c-3494-4877-8ee5-3856fc3772d8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.128075 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37273f8c-3494-4877-8ee5-3856fc3772d8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.128841 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37273f8c-3494-4877-8ee5-3856fc3772d8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.129349 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-37273f8c-3494-4877-8ee5-3856fc3772d8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.269167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-37273f8c-3494-4877-8ee5-3856fc3772d8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:07.277505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-37273f8c-3494-4877-8ee5-3856fc3772d8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.162156 Aug 02 09:20:07.278124 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 679/1348] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:07 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:08.299188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4a1b30ba-e360-46da-a45d-c89babf3ac9c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:08.299715 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4a1b30ba-e360-46da-a45d-c89babf3ac9c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:08.306458 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4a1b30ba-e360-46da-a45d-c89babf3ac9c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.306894 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4a1b30ba-e360-46da-a45d-c89babf3ac9c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.307644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4a1b30ba-e360-46da-a45d-c89babf3ac9c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.308070 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4a1b30ba-e360-46da-a45d-c89babf3ac9c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.436228 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4a1b30ba-e360-46da-a45d-c89babf3ac9c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:08.443562 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4a1b30ba-e360-46da-a45d-c89babf3ac9c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.148340 Aug 02 09:20:08.444135 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 670/1349] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:08 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:09.384113 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d79fd48b-d7dd-4c68-961d-fbc1fe024d3b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.384667 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d79fd48b-d7dd-4c68-961d-fbc1fe024d3b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:09.391075 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d79fd48b-d7dd-4c68-961d-fbc1fe024d3b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.391519 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d79fd48b-d7dd-4c68-961d-fbc1fe024d3b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.392385 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d79fd48b-d7dd-4c68-961d-fbc1fe024d3b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.392735 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d79fd48b-d7dd-4c68-961d-fbc1fe024d3b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.420074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d79fd48b-d7dd-4c68-961d-fbc1fe024d3b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Going to try to terminate instance {{(pid=118368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:20:09.508254 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-f3304dd4-8d43-4683-8886-273119f67cde req-ac80d5ab-a517-484a-80bd-f4afadf32a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7229a9c-5e58-4508-815a-5b5c0ed5f54b", "tag": "5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:09.518740 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-f3304dd4-8d43-4683-8886-273119f67cde req-ac80d5ab-a517-484a-80bd-f4afadf32a99 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.519471 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-f3304dd4-8d43-4683-8886-273119f67cde req-ac80d5ab-a517-484a-80bd-f4afadf32a99 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.534900 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-f3304dd4-8d43-4683-8886-273119f67cde req-ac80d5ab-a517-484a-80bd-f4afadf32a99 service nova] Creating event network-changed:5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11 for instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b on hv-cinder-84713 Aug 02 09:20:09.540291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-f3304dd4-8d43-4683-8886-273119f67cde req-ac80d5ab-a517-484a-80bd-f4afadf32a99 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162959 Aug 02 09:20:09.540902 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 680/1350] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:09.548159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-236a6506-15d1-4e53-b308-ed6ae1e33405 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.548871 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-236a6506-15d1-4e53-b308-ed6ae1e33405 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:09.556352 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-236a6506-15d1-4e53-b308-ed6ae1e33405 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.556813 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-236a6506-15d1-4e53-b308-ed6ae1e33405 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.557605 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-236a6506-15d1-4e53-b308-ed6ae1e33405 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.558086 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-236a6506-15d1-4e53-b308-ed6ae1e33405 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.705188 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d79fd48b-d7dd-4c68-961d-fbc1fe024d3b tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 204 len: 0 microversion: 2.1 time: 0.324684 Aug 02 09:20:09.706234 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 671/1351] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:20:09 2022] DELETE /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:20:09.707905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-236a6506-15d1-4e53-b308-ed6ae1e33405 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:09.715672 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-40c62713-fde8-49a6-be09-fb26287f4ecc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.716240 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-40c62713-fde8-49a6-be09-fb26287f4ecc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:09.716357 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-236a6506-15d1-4e53-b308-ed6ae1e33405 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.173917 Aug 02 09:20:09.717082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 681/1352] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:09 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:09.734425 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-40c62713-fde8-49a6-be09-fb26287f4ecc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.734880 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-40c62713-fde8-49a6-be09-fb26287f4ecc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.735863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-40c62713-fde8-49a6-be09-fb26287f4ecc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.736128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-40c62713-fde8-49a6-be09-fb26287f4ecc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.886319 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-40c62713-fde8-49a6-be09-fb26287f4ecc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:09.893919 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-40c62713-fde8-49a6-be09-fb26287f4ecc tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.183270 Aug 02 09:20:09.894499 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 672/1353] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:09 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:10.741423 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0f99b6e0-d9f0-4a65-b3a2-b24f2b56763d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:10.742137 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0f99b6e0-d9f0-4a65-b3a2-b24f2b56763d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:10.749251 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f99b6e0-d9f0-4a65-b3a2-b24f2b56763d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.749695 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f99b6e0-d9f0-4a65-b3a2-b24f2b56763d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.750494 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f99b6e0-d9f0-4a65-b3a2-b24f2b56763d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.750923 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0f99b6e0-d9f0-4a65-b3a2-b24f2b56763d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.897566 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0f99b6e0-d9f0-4a65-b3a2-b24f2b56763d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:10.920068 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0f99b6e0-d9f0-4a65-b3a2-b24f2b56763d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.170261 Aug 02 09:20:10.920068 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 682/1354] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:10 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:10.920262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-5e2561bc-aa08-4355-b6af-a24fd3b79778 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:10.920262 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-5e2561bc-aa08-4355-b6af-a24fd3b79778 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:10.924007 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e2561bc-aa08-4355-b6af-a24fd3b79778 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.924542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e2561bc-aa08-4355-b6af-a24fd3b79778 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.933313 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e2561bc-aa08-4355-b6af-a24fd3b79778 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.933313 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-5e2561bc-aa08-4355-b6af-a24fd3b79778 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.065443 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-5e2561bc-aa08-4355-b6af-a24fd3b79778 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:11.073128 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-5e2561bc-aa08-4355-b6af-a24fd3b79778 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.160470 Aug 02 09:20:11.073789 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 673/1355] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:10 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:11.933735 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b06696c3-ee32-47b8-9439-d8291a5f2799 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:11.934428 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b06696c3-ee32-47b8-9439-d8291a5f2799 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:11.941623 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b06696c3-ee32-47b8-9439-d8291a5f2799 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.942153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b06696c3-ee32-47b8-9439-d8291a5f2799 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.943033 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b06696c3-ee32-47b8-9439-d8291a5f2799 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.943471 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b06696c3-ee32-47b8-9439-d8291a5f2799 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.074738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-b06696c3-ee32-47b8-9439-d8291a5f2799 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:12.082218 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b06696c3-ee32-47b8-9439-d8291a5f2799 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.153270 Aug 02 09:20:12.082803 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 683/1356] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:11 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:12.097491 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-14e3ac72-b4a7-413a-be72-d0d9050a3dc8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:12.098176 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-14e3ac72-b4a7-413a-be72-d0d9050a3dc8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:12.105021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14e3ac72-b4a7-413a-be72-d0d9050a3dc8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.105474 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14e3ac72-b4a7-413a-be72-d0d9050a3dc8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.106300 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14e3ac72-b4a7-413a-be72-d0d9050a3dc8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.106732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-14e3ac72-b4a7-413a-be72-d0d9050a3dc8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.499111 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-14e3ac72-b4a7-413a-be72-d0d9050a3dc8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:12.506534 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-14e3ac72-b4a7-413a-be72-d0d9050a3dc8 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.412986 Aug 02 09:20:12.507092 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 674/1357] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:12 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:13.103671 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-668f56bd-b491-4538-aabd-06d000afeef8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:13.104262 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-668f56bd-b491-4538-aabd-06d000afeef8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:13.111072 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-668f56bd-b491-4538-aabd-06d000afeef8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.111532 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-668f56bd-b491-4538-aabd-06d000afeef8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.112359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-668f56bd-b491-4538-aabd-06d000afeef8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.112856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-668f56bd-b491-4538-aabd-06d000afeef8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.257657 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-668f56bd-b491-4538-aabd-06d000afeef8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:13.266435 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-668f56bd-b491-4538-aabd-06d000afeef8 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.167543 Aug 02 09:20:13.267023 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 684/1358] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:13 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:13.527423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-4b20489d-1d82-4371-9fc9-ae214f419302 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:13.528131 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-4b20489d-1d82-4371-9fc9-ae214f419302 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:13.534743 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b20489d-1d82-4371-9fc9-ae214f419302 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.535191 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b20489d-1d82-4371-9fc9-ae214f419302 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.535952 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b20489d-1d82-4371-9fc9-ae214f419302 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.536377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-4b20489d-1d82-4371-9fc9-ae214f419302 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.713419 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-4b20489d-1d82-4371-9fc9-ae214f419302 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:13.720968 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-4b20489d-1d82-4371-9fc9-ae214f419302 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1569 microversion: 2.1 time: 0.197395 Aug 02 09:20:13.723050 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 675/1359] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:13 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:13.870599 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-aac5a8a6-80e1-49ff-99a6-808a7d85a9ed req-d775f9e5-63a6-4388-b5a2-5b3a19cdd5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7229a9c-5e58-4508-815a-5b5c0ed5f54b", "name": "network-vif-deleted", "tag": "5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:13.879807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-aac5a8a6-80e1-49ff-99a6-808a7d85a9ed req-d775f9e5-63a6-4388-b5a2-5b3a19cdd5bb service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.880245 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-aac5a8a6-80e1-49ff-99a6-808a7d85a9ed req-d775f9e5-63a6-4388-b5a2-5b3a19cdd5bb service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.890907 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-aac5a8a6-80e1-49ff-99a6-808a7d85a9ed req-d775f9e5-63a6-4388-b5a2-5b3a19cdd5bb service nova] Creating event network-vif-deleted:5f914bb4-cfdd-4fbf-ad1e-ae4f5c491d11 for instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b on hv-cinder-84713 Aug 02 09:20:13.895888 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-aac5a8a6-80e1-49ff-99a6-808a7d85a9ed req-d775f9e5-63a6-4388-b5a2-5b3a19cdd5bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029615 Aug 02 09:20:13.896455 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 685/1360] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:14.292823 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3654e38e-9b1b-4126-bd88-ee4914263f6d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:14.293423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3654e38e-9b1b-4126-bd88-ee4914263f6d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:14.300367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3654e38e-9b1b-4126-bd88-ee4914263f6d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.300808 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3654e38e-9b1b-4126-bd88-ee4914263f6d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.301647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3654e38e-9b1b-4126-bd88-ee4914263f6d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.302120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3654e38e-9b1b-4126-bd88-ee4914263f6d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.436184 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3654e38e-9b1b-4126-bd88-ee4914263f6d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:14.443943 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3654e38e-9b1b-4126-bd88-ee4914263f6d tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.155522 Aug 02 09:20:14.444509 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 676/1361] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:14 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:14.744330 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:14.745039 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:14.751674 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.752143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.752918 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.753348 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.786508 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.786952 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.787391 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lazy-loading 'fault' on Instance uuid c7229a9c-5e58-4508-815a-5b5c0ed5f54b {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:20:14.830057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1300b00c7214d168e72850a8585bd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142acfd7d2a7483083b9807280598eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:14.837563 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-67d4d1be-7f39-4cf6-aa45-288587f0609a tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 200 len: 1224 microversion: 2.1 time: 0.098125 Aug 02 09:20:14.838167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 686/1362] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:14 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:15.465955 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-066586b4-1db6-414a-89a4-ea349b6a03c6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:15.466557 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-066586b4-1db6-414a-89a4-ea349b6a03c6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:15.473303 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-066586b4-1db6-414a-89a4-ea349b6a03c6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.473759 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-066586b4-1db6-414a-89a4-ea349b6a03c6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.474659 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-066586b4-1db6-414a-89a4-ea349b6a03c6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.475095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-066586b4-1db6-414a-89a4-ea349b6a03c6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.612244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-066586b4-1db6-414a-89a4-ea349b6a03c6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:15.620020 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-066586b4-1db6-414a-89a4-ea349b6a03c6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.158409 Aug 02 09:20:15.620594 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 677/1363] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:15 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:15.859602 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:15.860221 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] [instance: c7229a9c-5e58-4508-815a-5b5c0ed5f54b] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:15.866887 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.867337 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.868152 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.868609 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.883418 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] HTTP exception thrown: Instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b could not be found. Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Request method failure captured: Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b HTTP/1.1 Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OrysYaC9T7zRi_HDhS4N0z8EqOB5295A3Hb-VyH2B1VYeVOK5svBn62EDdHyjKb_k8O9UzUTS-kmexiifs5-uKbMIdOZfZa5iVKjZD6lwGbbmrmSPkLA48IDG39RlaOkp9EgQE_XRYu-n2IH16w_JSstvgpp3cXb2KlJ0uQtQRylJw Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: 142acfd7d2a7483083b9807280598eef Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-TestShelveInstance-1007850412 Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:20:15.885600 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/142acfd7d2a7483083b9807280598eef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/142acfd7d2a7483083b9807280598eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_142acfd7d2a7483083b9807280598eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/142acfd7d2a7483083b9807280598eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-TestShelveInstance-1007850412 Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: 142acfd7d2a7483083b9807280598eef Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-TestShelveInstance-1007850412 Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-TestShelveInstance-1007850412-project Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: a1300b00c7214d168e72850a8585bd47 Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-TestShelveInstance-1007850412-project Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b could not be found. Aug 02 09:20:15.887433 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'c7229a9c-5e58-4508-815a-5b5c0ed5f54b'} Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b could not be found. Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:20:15.888460 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b could not be found. Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b could not be found. Aug 02 09:20:15.890160 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:20:15.891578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Returning 404 to user: Instance c7229a9c-5e58-4508-815a-5b5c0ed5f54b could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:20:15.891578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-31582131-7141-4ceb-9eab-34236b98a866 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b" status: 404 len: 111 microversion: 2.1 time: 0.031358 Aug 02 09:20:15.891578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 687/1364] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:15 2022] GET /compute/v2.1/servers/c7229a9c-5e58-4508-815a-5b5c0ed5f54b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:20:16.120883 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fd69cb5c-f11a-466d-ade1-c0df32344c85 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] Calling method '.version_select at 0x7f0f2d99c790>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:16.186001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fd69cb5c-f11a-466d-ade1-c0df32344c85 tempest-TestShelveInstance-1007850412 tempest-TestShelveInstance-1007850412-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-686869677" status: 202 len: 0 microversion: 2.1 time: 0.068810 Aug 02 09:20:16.186592 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 678/1365] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 2 09:20:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-686869677 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:20:16.640830 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8b8de9ad-713e-4ee2-b72b-2992b759b264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:16.641484 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8b8de9ad-713e-4ee2-b72b-2992b759b264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:16.647544 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8b8de9ad-713e-4ee2-b72b-2992b759b264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.647989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8b8de9ad-713e-4ee2-b72b-2992b759b264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.648780 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8b8de9ad-713e-4ee2-b72b-2992b759b264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.649328 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8b8de9ad-713e-4ee2-b72b-2992b759b264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.806769 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8b8de9ad-713e-4ee2-b72b-2992b759b264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:16.815585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8b8de9ad-713e-4ee2-b72b-2992b759b264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.178523 Aug 02 09:20:16.816159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 688/1366] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:16 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:17.837038 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a2e0c1d5-b6da-4a22-97da-c4de2c6dce6c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:17.837716 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a2e0c1d5-b6da-4a22-97da-c4de2c6dce6c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:17.844980 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a2e0c1d5-b6da-4a22-97da-c4de2c6dce6c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.845533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a2e0c1d5-b6da-4a22-97da-c4de2c6dce6c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.846564 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a2e0c1d5-b6da-4a22-97da-c4de2c6dce6c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.847314 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a2e0c1d5-b6da-4a22-97da-c4de2c6dce6c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.074149 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-a2e0c1d5-b6da-4a22-97da-c4de2c6dce6c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:18.083712 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a2e0c1d5-b6da-4a22-97da-c4de2c6dce6c tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.250914 Aug 02 09:20:18.085525 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 679/1367] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:17 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:19.108961 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f78d55c7-97e5-4b19-bb6d-e1f4dbb1d2a3 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:19.110532 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f78d55c7-97e5-4b19-bb6d-e1f4dbb1d2a3 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:19.119021 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f78d55c7-97e5-4b19-bb6d-e1f4dbb1d2a3 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.119856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f78d55c7-97e5-4b19-bb6d-e1f4dbb1d2a3 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.120874 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f78d55c7-97e5-4b19-bb6d-e1f4dbb1d2a3 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.121534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f78d55c7-97e5-4b19-bb6d-e1f4dbb1d2a3 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.400421 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-f78d55c7-97e5-4b19-bb6d-e1f4dbb1d2a3 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:19.409298 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f78d55c7-97e5-4b19-bb6d-e1f4dbb1d2a3 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.305154 Aug 02 09:20:19.410057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 689/1368] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:19 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:20.432479 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-fd9e72fd-4776-42ac-b75b-93fd0ccc0c84 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:20.433086 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-fd9e72fd-4776-42ac-b75b-93fd0ccc0c84 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:20.440440 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd9e72fd-4776-42ac-b75b-93fd0ccc0c84 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.441205 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd9e72fd-4776-42ac-b75b-93fd0ccc0c84 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.443146 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd9e72fd-4776-42ac-b75b-93fd0ccc0c84 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.443596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-fd9e72fd-4776-42ac-b75b-93fd0ccc0c84 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.481596 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-01886319-5f16-4599-93ce-0893ec3625a3 req-e3a9adbd-2582-4a9c-acad-5ff6c7cb5e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f0a27d-cdc0-4355-a295-edf59d4ffa05", "name": "network-vif-plugged", "status": "completed", "tag": "e79c2678-5fc2-4bdf-9965-eade0f761a7e"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:20.496976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-01886319-5f16-4599-93ce-0893ec3625a3 req-e3a9adbd-2582-4a9c-acad-5ff6c7cb5e83 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.497428 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-01886319-5f16-4599-93ce-0893ec3625a3 req-e3a9adbd-2582-4a9c-acad-5ff6c7cb5e83 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.511585 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-01886319-5f16-4599-93ce-0893ec3625a3 req-e3a9adbd-2582-4a9c-acad-5ff6c7cb5e83 service nova] Creating event network-vif-plugged:e79c2678-5fc2-4bdf-9965-eade0f761a7e for instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 on hv-cinder-84713 Aug 02 09:20:20.516851 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-01886319-5f16-4599-93ce-0893ec3625a3 req-e3a9adbd-2582-4a9c-acad-5ff6c7cb5e83 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042016 Aug 02 09:20:20.517955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 690/1369] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:20.787273 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-fd9e72fd-4776-42ac-b75b-93fd0ccc0c84 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:20.791250 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:20.797343 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-fd9e72fd-4776-42ac-b75b-93fd0ccc0c84 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.369791 Aug 02 09:20:20.801403 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 680/1370] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:20 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:21.824381 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4686166a-3c0e-4e5d-9538-f27f74856bd6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:21.825063 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4686166a-3c0e-4e5d-9538-f27f74856bd6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:21.831466 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4686166a-3c0e-4e5d-9538-f27f74856bd6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.831847 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4686166a-3c0e-4e5d-9538-f27f74856bd6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.832610 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4686166a-3c0e-4e5d-9538-f27f74856bd6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.833038 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4686166a-3c0e-4e5d-9538-f27f74856bd6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.046261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4686166a-3c0e-4e5d-9538-f27f74856bd6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:22.054128 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4686166a-3c0e-4e5d-9538-f27f74856bd6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1266 microversion: 2.1 time: 0.235011 Aug 02 09:20:22.054702 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 691/1371] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:21 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:23.076698 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-aab874f6-d6c2-4d3e-8d18-82e05a30823f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:23.078175 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-aab874f6-d6c2-4d3e-8d18-82e05a30823f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:23.085323 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aab874f6-d6c2-4d3e-8d18-82e05a30823f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.086122 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aab874f6-d6c2-4d3e-8d18-82e05a30823f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.087139 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aab874f6-d6c2-4d3e-8d18-82e05a30823f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.087660 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-aab874f6-d6c2-4d3e-8d18-82e05a30823f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.246675 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-aab874f6-d6c2-4d3e-8d18-82e05a30823f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:23.254373 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-aab874f6-d6c2-4d3e-8d18-82e05a30823f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1454 microversion: 2.1 time: 0.181726 Aug 02 09:20:23.255450 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 681/1372] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:23 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:23.275905 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ab1b6bb8-bb78-4acd-955b-582efb5c663b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:23.276602 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ab1b6bb8-bb78-4acd-955b-582efb5c663b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:23.279235 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:23.284690 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ab1b6bb8-bb78-4acd-955b-582efb5c663b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.285259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ab1b6bb8-bb78-4acd-955b-582efb5c663b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.286217 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ab1b6bb8-bb78-4acd-955b-582efb5c663b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.286726 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ab1b6bb8-bb78-4acd-955b-582efb5c663b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.291724 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=87 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:23.496865 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-ab1b6bb8-bb78-4acd-955b-582efb5c663b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:23.504167 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ab1b6bb8-bb78-4acd-955b-582efb5c663b tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1454 microversion: 2.1 time: 0.232170 Aug 02 09:20:23.504723 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 692/1373] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:23 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1454 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:26.084664 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-5deee453-2805-4e20-9928-a61029aa0e0e req-5f165bb7-1125-4396-9ef4-fca867f4c7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f0a27d-cdc0-4355-a295-edf59d4ffa05", "tag": "e79c2678-5fc2-4bdf-9965-eade0f761a7e"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:26.091018 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:26.096153 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-5deee453-2805-4e20-9928-a61029aa0e0e req-5f165bb7-1125-4396-9ef4-fca867f4c7d1 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.096597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-5deee453-2805-4e20-9928-a61029aa0e0e req-5f165bb7-1125-4396-9ef4-fca867f4c7d1 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.108619 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-5deee453-2805-4e20-9928-a61029aa0e0e req-5f165bb7-1125-4396-9ef4-fca867f4c7d1 service nova] Creating event network-changed:e79c2678-5fc2-4bdf-9965-eade0f761a7e for instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 on hv-cinder-84713 Aug 02 09:20:26.113737 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-5deee453-2805-4e20-9928-a61029aa0e0e req-5f165bb7-1125-4396-9ef4-fca867f4c7d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032891 Aug 02 09:20:26.114618 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 682/1374] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:50.522240 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-fcac8f91-9506-4efe-9005-c1f5f9a9d730 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:50.524410 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-fcac8f91-9506-4efe-9005-c1f5f9a9d730 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:50.526639 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:50.527452 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=5 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:50.531955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fcac8f91-9506-4efe-9005-c1f5f9a9d730 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.532399 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fcac8f91-9506-4efe-9005-c1f5f9a9d730 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.533149 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fcac8f91-9506-4efe-9005-c1f5f9a9d730 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.533577 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-fcac8f91-9506-4efe-9005-c1f5f9a9d730 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.562586 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-fcac8f91-9506-4efe-9005-c1f5f9a9d730 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044280 Aug 02 09:20:50.563139 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 693/1375] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:20:50 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:20:50.623062 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=8 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:50.627639 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6a7ee88f-c1fd-47eb-abf3-bd15e844021f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:50.628453 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6a7ee88f-c1fd-47eb-abf3-bd15e844021f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:50.637133 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a7ee88f-c1fd-47eb-abf3-bd15e844021f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.637588 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a7ee88f-c1fd-47eb-abf3-bd15e844021f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.638495 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a7ee88f-c1fd-47eb-abf3-bd15e844021f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.638936 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6a7ee88f-c1fd-47eb-abf3-bd15e844021f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.670390 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6a7ee88f-c1fd-47eb-abf3-bd15e844021f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Going to try to terminate instance {{(pid=118368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:20:51.011469 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6a7ee88f-c1fd-47eb-abf3-bd15e844021f tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 204 len: 0 microversion: 2.1 time: 0.389769 Aug 02 09:20:51.012112 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 683/1376] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:20:50 2022] DELETE /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:20:51.020759 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a29650d6-ec44-4782-9a16-8899f8faf005 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:51.024226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a29650d6-ec44-4782-9a16-8899f8faf005 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:51.028258 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a29650d6-ec44-4782-9a16-8899f8faf005 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.028706 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a29650d6-ec44-4782-9a16-8899f8faf005 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.029469 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a29650d6-ec44-4782-9a16-8899f8faf005 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.029916 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a29650d6-ec44-4782-9a16-8899f8faf005 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.161587 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-a29650d6-ec44-4782-9a16-8899f8faf005 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:51.169063 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a29650d6-ec44-4782-9a16-8899f8faf005 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1674 microversion: 2.1 time: 0.152722 Aug 02 09:20:51.169621 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 694/1377] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:51 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:52.405613 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-45ee5e17-6434-4418-b57c-5d95eab6c2ef tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:52.406335 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-45ee5e17-6434-4418-b57c-5d95eab6c2ef tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:52.412340 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-45ee5e17-6434-4418-b57c-5d95eab6c2ef tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.412781 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-45ee5e17-6434-4418-b57c-5d95eab6c2ef tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.413550 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-45ee5e17-6434-4418-b57c-5d95eab6c2ef tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.414012 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-45ee5e17-6434-4418-b57c-5d95eab6c2ef tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.542156 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-45ee5e17-6434-4418-b57c-5d95eab6c2ef tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:52.549457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-45ee5e17-6434-4418-b57c-5d95eab6c2ef tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1674 microversion: 2.1 time: 0.361767 Aug 02 09:20:52.550045 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 684/1378] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:52 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1674 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:53.571652 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e2eb4bc6-b8e3-4557-9da0-5d72667090dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:53.572275 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e2eb4bc6-b8e3-4557-9da0-5d72667090dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:53.579919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e2eb4bc6-b8e3-4557-9da0-5d72667090dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.584612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e2eb4bc6-b8e3-4557-9da0-5d72667090dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.584612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e2eb4bc6-b8e3-4557-9da0-5d72667090dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.584612 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e2eb4bc6-b8e3-4557-9da0-5d72667090dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.745207 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e2eb4bc6-b8e3-4557-9da0-5d72667090dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:53.754071 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e2eb4bc6-b8e3-4557-9da0-5d72667090dc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1674 microversion: 2.1 time: 0.187557 Aug 02 09:20:53.754766 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 695/1379] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:53 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:54.466805 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-571b4757-5280-4e65-8941-cbdc2fd5692e req-90c7da83-ec6e-4d55-986b-f1b8bab7fa1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04e0dc0-229f-4f7e-a56b-582dcc6b64fd", "name": "network-vif-deleted", "tag": "b514c4a7-357e-4788-9c3b-2c6b5ae99179"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:54.479381 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-571b4757-5280-4e65-8941-cbdc2fd5692e req-90c7da83-ec6e-4d55-986b-f1b8bab7fa1b service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.480489 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-571b4757-5280-4e65-8941-cbdc2fd5692e req-90c7da83-ec6e-4d55-986b-f1b8bab7fa1b service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.497702 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-571b4757-5280-4e65-8941-cbdc2fd5692e req-90c7da83-ec6e-4d55-986b-f1b8bab7fa1b service nova] Creating event network-vif-deleted:b514c4a7-357e-4788-9c3b-2c6b5ae99179 for instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd on hv-cinder-84713 Aug 02 09:20:54.510624 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-571b4757-5280-4e65-8941-cbdc2fd5692e req-90c7da83-ec6e-4d55-986b-f1b8bab7fa1b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046722 Aug 02 09:20:54.516077 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 685/1380] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:54.776524 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-5fc1c839-eff7-4759-8cdc-17e4e59f8c97 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:54.777069 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-5fc1c839-eff7-4759-8cdc-17e4e59f8c97 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:54.783959 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5fc1c839-eff7-4759-8cdc-17e4e59f8c97 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.784337 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5fc1c839-eff7-4759-8cdc-17e4e59f8c97 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.785197 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5fc1c839-eff7-4759-8cdc-17e4e59f8c97 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.785520 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-5fc1c839-eff7-4759-8cdc-17e4e59f8c97 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.854161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-5fc1c839-eff7-4759-8cdc-17e4e59f8c97 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:54.861732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-5fc1c839-eff7-4759-8cdc-17e4e59f8c97 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 200 len: 1323 microversion: 2.1 time: 0.089669 Aug 02 09:20:54.862336 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 696/1381] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:54 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:55.883736 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:55.884413 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:55.890544 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.890989 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.891731 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.892158 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.905501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] HTTP exception thrown: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Request method failure captured: Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd HTTP/1.1 Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OtHrrQzSMrJwBIbL-PRJMBqbH7LYsqGddoTGkFvzjqJE7oIOqQJFL0KG0KjZ-mOsyo_MifvCl43CjoazoSrCJIRqwjsN22YhlgyvA2twwaaGqM-nO0ok7TkKldo83Or5E3sTIi-0Km5bb8SY3p-T4d2vS8Aeq9ziegdhHQBJWHrWUU Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:20:55.907241 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 77aff587ea964860895cd4dce03f2158 Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:20:55.909040 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'e04e0dc0-229f-4f7e-a56b-582dcc6b64fd'} Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:20:55.910083 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:20:55.911533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:20:55.912962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Returning 404 to user: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:20:55.912962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-7a8d013e-f314-4695-9981-c44e0573a958 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 404 len: 111 microversion: 2.1 time: 0.029474 Aug 02 09:20:55.912962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 686/1382] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:55 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:20:55.918023 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ce2056fb-2f66-4b4f-9b80-6c04d2e30f55 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '.version_select at 0x7f0f31efac10>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:56.018505 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ce2056fb-2f66-4b4f-9b80-6c04d2e30f55 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308012122" status: 202 len: 0 microversion: 2.1 time: 0.104705 Aug 02 09:20:56.019220 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 697/1383] 10.222.0.46 () {58 vars in 1221 bytes} [Tue Aug 2 09:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308012122 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:20:56.763213 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a3198be2-3a0d-4c83-961a-13501917ff15 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'create', calling method: .version_select at 0x7f0f2d80d040>, body: {"keypair": {"name": "tempest-keypair-375746643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPAgA+c3i4WIMzYrE/5dwOwq2ibVIhQMmv/Aacsz0b/iJqMt8Mf6tqBlpwJmOqRjdLpzmmmLlQ5TosmSG2wzlGSIV4mSdWqfmkWPejV6vtifkjA7HjKO+vcH386yAei4g=="}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:56.778367 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-a3198be2-3a0d-4c83-961a-13501917ff15 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Getting quotas for project bfaca149a97a44cf84f9d21fa65510b6. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:20:56.782307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.quota [None req-a3198be2-3a0d-4c83-961a-13501917ff15 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Getting quotas for user 77aff587ea964860895cd4dce03f2158 and project bfaca149a97a44cf84f9d21fa65510b6. Resources: {'key_pairs'} {{(pid=118368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:20:56.864338 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a3198be2-3a0d-4c83-961a-13501917ff15 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105146 Aug 02 09:20:56.864944 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 687/1384] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 2 09:20:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:58.994050 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1187349860", "imageRef": "a1265c05-189f-4f8f-86af-959c2efcd1ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7acbcc3f-63ce-47e1-b1eb-b196cd2049fd"}], "security_groups": [{"name": "tempest-securitygroup--354050293"}], "key_name": "tempest-keypair-375746643", "user_data": "}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:59.097442 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.network.neutron [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] validate_networks() for [('7acbcc3f-63ce-47e1-b1eb-b196cd2049fd', None, None, None, None, None)] {{(pid=118366) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:20:59.464477 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Flavor limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:20:59.464891 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Image limits 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:20:59.465354 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Flavor pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:20:59.465754 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Image pref 0:0:0 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:20:59.466180 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.virt.hardware [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:20:59.474774 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.475213 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.475996 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.476929 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.495772 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Getting quotas for project bfaca149a97a44cf84f9d21fa65510b6. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:20:59.499667 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.quota [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Getting quotas for user 77aff587ea964860895cd4dce03f2158 and project bfaca149a97a44cf84f9d21fa65510b6. Resources: {'instances', 'ram', 'cores'} {{(pid=118366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:20:59.510296 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Going to run 1 instances... {{(pid=118366) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:20:59.512517 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1265c05-189f-4f8f-86af-959c2efcd1ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:20:59.655312 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3ad9b229-631b-400b-92e0-31c1fda27382 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.666427 Aug 02 09:20:59.656091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 698/1385] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 2 09:20:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:20:59.667732 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-892ca8a0-b661-42a0-be29-ada8ad44e2fd tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:59.672933 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-892ca8a0-b661-42a0-be29-ada8ad44e2fd tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:59.725600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-892ca8a0-b661-42a0-be29-ada8ad44e2fd tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:59.733075 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-892ca8a0-b661-42a0-be29-ada8ad44e2fd tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1237 microversion: 2.1 time: 0.069895 Aug 02 09:20:59.733644 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 688/1386] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:59 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:00.761270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e17e4129-6ead-4a4b-bdd8-0325cdeaa4d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:00.761270 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e17e4129-6ead-4a4b-bdd8-0325cdeaa4d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:00.763653 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e17e4129-6ead-4a4b-bdd8-0325cdeaa4d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.764108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e17e4129-6ead-4a4b-bdd8-0325cdeaa4d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.764920 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e17e4129-6ead-4a4b-bdd8-0325cdeaa4d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.765363 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e17e4129-6ead-4a4b-bdd8-0325cdeaa4d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.827430 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-e17e4129-6ead-4a4b-bdd8-0325cdeaa4d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:00.834823 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e17e4129-6ead-4a4b-bdd8-0325cdeaa4d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1241 microversion: 2.1 time: 0.083512 Aug 02 09:21:00.835390 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 699/1387] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:00 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:01.856454 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-faee1e2c-2e22-4dfd-aaf5-7f4464aede86 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:01.857198 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-faee1e2c-2e22-4dfd-aaf5-7f4464aede86 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:01.864423 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-faee1e2c-2e22-4dfd-aaf5-7f4464aede86 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.864975 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-faee1e2c-2e22-4dfd-aaf5-7f4464aede86 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.865920 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-faee1e2c-2e22-4dfd-aaf5-7f4464aede86 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.866841 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-faee1e2c-2e22-4dfd-aaf5-7f4464aede86 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.947089 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-faee1e2c-2e22-4dfd-aaf5-7f4464aede86 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:01.955384 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-faee1e2c-2e22-4dfd-aaf5-7f4464aede86 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1295 microversion: 2.1 time: 0.103613 Aug 02 09:21:01.955960 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 689/1388] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:01 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1295 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:02.977526 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0985e1e7-3872-4e0a-a0cd-71e1e386d86e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:02.978174 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0985e1e7-3872-4e0a-a0cd-71e1e386d86e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:02.984434 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0985e1e7-3872-4e0a-a0cd-71e1e386d86e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.984883 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0985e1e7-3872-4e0a-a0cd-71e1e386d86e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.985644 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0985e1e7-3872-4e0a-a0cd-71e1e386d86e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.986359 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0985e1e7-3872-4e0a-a0cd-71e1e386d86e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.114311 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-0985e1e7-3872-4e0a-a0cd-71e1e386d86e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:03.121738 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0985e1e7-3872-4e0a-a0cd-71e1e386d86e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1362 microversion: 2.1 time: 0.148643 Aug 02 09:21:03.122356 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 700/1389] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:02 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:03.149283 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-e89ab1c7-8b52-45aa-9362-c5332a569ca2 req-81a02cb0-ea27-41cf-8edc-eac61c093620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13612e0f-d519-49c2-a5a3-781b032c9711", "tag": "f60aa2dc-d082-482d-9393-230f8d31e53e"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:03.159647 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-e89ab1c7-8b52-45aa-9362-c5332a569ca2 req-81a02cb0-ea27-41cf-8edc-eac61c093620 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.160168 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-e89ab1c7-8b52-45aa-9362-c5332a569ca2 req-81a02cb0-ea27-41cf-8edc-eac61c093620 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.171762 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-e89ab1c7-8b52-45aa-9362-c5332a569ca2 req-81a02cb0-ea27-41cf-8edc-eac61c093620 service nova] Creating event network-changed:f60aa2dc-d082-482d-9393-230f8d31e53e for instance 13612e0f-d519-49c2-a5a3-781b032c9711 on hv-cinder-84713 Aug 02 09:21:03.176928 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-e89ab1c7-8b52-45aa-9362-c5332a569ca2 req-81a02cb0-ea27-41cf-8edc-eac61c093620 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032611 Aug 02 09:21:03.177698 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 690/1390] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:04.142492 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-9cd7e963-f9e3-441b-9b99-722876de74bb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:04.143104 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-9cd7e963-f9e3-441b-9b99-722876de74bb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:04.150278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9cd7e963-f9e3-441b-9b99-722876de74bb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.150731 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9cd7e963-f9e3-441b-9b99-722876de74bb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.151502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9cd7e963-f9e3-441b-9b99-722876de74bb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.151939 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-9cd7e963-f9e3-441b-9b99-722876de74bb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.285195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-9cd7e963-f9e3-441b-9b99-722876de74bb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:04.293388 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-9cd7e963-f9e3-441b-9b99-722876de74bb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1362 microversion: 2.1 time: 0.154786 Aug 02 09:21:04.293999 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 701/1391] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:04 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:05.314949 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2e569ebb-0747-45cf-8b95-61c31fbf02ea tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:05.315600 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2e569ebb-0747-45cf-8b95-61c31fbf02ea tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:05.322574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e569ebb-0747-45cf-8b95-61c31fbf02ea tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.323029 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e569ebb-0747-45cf-8b95-61c31fbf02ea tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.323800 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e569ebb-0747-45cf-8b95-61c31fbf02ea tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.324237 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2e569ebb-0747-45cf-8b95-61c31fbf02ea tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.451330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2e569ebb-0747-45cf-8b95-61c31fbf02ea tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:05.458693 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2e569ebb-0747-45cf-8b95-61c31fbf02ea tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1362 microversion: 2.1 time: 0.148563 Aug 02 09:21:05.459257 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 691/1392] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:05 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:06.479746 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-28473550-1bef-423a-988d-5980ab6100ff tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:06.480367 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-28473550-1bef-423a-988d-5980ab6100ff tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:06.486949 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-28473550-1bef-423a-988d-5980ab6100ff tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.487404 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-28473550-1bef-423a-988d-5980ab6100ff tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.488176 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-28473550-1bef-423a-988d-5980ab6100ff tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.488609 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-28473550-1bef-423a-988d-5980ab6100ff tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.617872 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-28473550-1bef-423a-988d-5980ab6100ff tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:06.625701 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-28473550-1bef-423a-988d-5980ab6100ff tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1362 microversion: 2.1 time: 0.149813 Aug 02 09:21:06.626304 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 702/1393] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:06 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:07.646359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-2fe86036-4d75-445e-be4b-fc4b2d9f5f31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:07.646982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-2fe86036-4d75-445e-be4b-fc4b2d9f5f31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:07.654094 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2fe86036-4d75-445e-be4b-fc4b2d9f5f31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.654541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2fe86036-4d75-445e-be4b-fc4b2d9f5f31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.655299 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2fe86036-4d75-445e-be4b-fc4b2d9f5f31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.655731 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-2fe86036-4d75-445e-be4b-fc4b2d9f5f31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.791175 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-2fe86036-4d75-445e-be4b-fc4b2d9f5f31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:07.799006 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-2fe86036-4d75-445e-be4b-fc4b2d9f5f31 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1362 microversion: 2.1 time: 0.156421 Aug 02 09:21:07.799574 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 692/1394] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:07 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:08.820154 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-2a1f0006-8c5d-42e9-b543-e8a438ac54f9 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:08.820765 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-2a1f0006-8c5d-42e9-b543-e8a438ac54f9 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:08.827338 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2a1f0006-8c5d-42e9-b543-e8a438ac54f9 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.827791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2a1f0006-8c5d-42e9-b543-e8a438ac54f9 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.828553 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2a1f0006-8c5d-42e9-b543-e8a438ac54f9 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.828993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-2a1f0006-8c5d-42e9-b543-e8a438ac54f9 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.962195 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-2a1f0006-8c5d-42e9-b543-e8a438ac54f9 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:08.969536 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-2a1f0006-8c5d-42e9-b543-e8a438ac54f9 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1362 microversion: 2.1 time: 0.153408 Aug 02 09:21:08.970119 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 703/1395] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:08 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:09.958753 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell0:SELECT=6 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:09.964549 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-cd742c76-34e4-467c-8af8-09fb0970479e req-74c493c7-d64d-49eb-912f-bc6072cc8588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13612e0f-d519-49c2-a5a3-781b032c9711", "name": "network-vif-plugged", "status": "completed", "tag": "f60aa2dc-d082-482d-9393-230f8d31e53e"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:09.973124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-cd742c76-34e4-467c-8af8-09fb0970479e req-74c493c7-d64d-49eb-912f-bc6072cc8588 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.973567 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-cd742c76-34e4-467c-8af8-09fb0970479e req-74c493c7-d64d-49eb-912f-bc6072cc8588 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.985508 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-cd742c76-34e4-467c-8af8-09fb0970479e req-74c493c7-d64d-49eb-912f-bc6072cc8588 service nova] Creating event network-vif-plugged:f60aa2dc-d082-482d-9393-230f8d31e53e for instance 13612e0f-d519-49c2-a5a3-781b032c9711 on hv-cinder-84713 Aug 02 09:21:09.990710 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-cd742c76-34e4-467c-8af8-09fb0970479e req-74c493c7-d64d-49eb-912f-bc6072cc8588 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Aug 02 09:21:09.991307 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 693/1396] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:09.992374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-4d8d8649-abea-4a80-861d-2fa169acd0fc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:09.993188 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-4d8d8649-abea-4a80-861d-2fa169acd0fc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:09.995230 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=2 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:09.995890 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell0:SELECT=6 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:10.001203 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4d8d8649-abea-4a80-861d-2fa169acd0fc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.001647 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4d8d8649-abea-4a80-861d-2fa169acd0fc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.002436 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4d8d8649-abea-4a80-861d-2fa169acd0fc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.002861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-4d8d8649-abea-4a80-861d-2fa169acd0fc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.140870 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-4d8d8649-abea-4a80-861d-2fa169acd0fc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:10.149507 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-4d8d8649-abea-4a80-861d-2fa169acd0fc tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1362 microversion: 2.1 time: 0.162239 Aug 02 09:21:10.150107 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 704/1397] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:09 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:11.171312 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-02671114-435c-4904-98e2-685f1a121d20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:11.172003 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-02671114-435c-4904-98e2-685f1a121d20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:11.178741 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-02671114-435c-4904-98e2-685f1a121d20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.179191 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-02671114-435c-4904-98e2-685f1a121d20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.180918 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-02671114-435c-4904-98e2-685f1a121d20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.181355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-02671114-435c-4904-98e2-685f1a121d20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.308053 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-02671114-435c-4904-98e2-685f1a121d20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:11.315288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-02671114-435c-4904-98e2-685f1a121d20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1362 microversion: 2.1 time: 0.148663 Aug 02 09:21:11.315851 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 694/1398] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:11 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:12.336208 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-be667928-f3cc-45d9-b66e-d187beaedd6e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:12.336845 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-be667928-f3cc-45d9-b66e-d187beaedd6e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:12.343637 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-be667928-f3cc-45d9-b66e-d187beaedd6e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.344088 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-be667928-f3cc-45d9-b66e-d187beaedd6e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.344849 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-be667928-f3cc-45d9-b66e-d187beaedd6e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.345287 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-be667928-f3cc-45d9-b66e-d187beaedd6e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.473993 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-be667928-f3cc-45d9-b66e-d187beaedd6e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:12.481769 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-be667928-f3cc-45d9-b66e-d187beaedd6e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1548 microversion: 2.1 time: 0.149920 Aug 02 09:21:12.482360 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 705/1399] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:12 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:12.502074 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-6afc45da-b759-430d-b0d4-abb88420b888 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:12.502609 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-6afc45da-b759-430d-b0d4-abb88420b888 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:12.508958 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6afc45da-b759-430d-b0d4-abb88420b888 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.509393 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6afc45da-b759-430d-b0d4-abb88420b888 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.510161 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6afc45da-b759-430d-b0d4-abb88420b888 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.510587 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-6afc45da-b759-430d-b0d4-abb88420b888 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.591330 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-6afc45da-b759-430d-b0d4-abb88420b888 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093040 Aug 02 09:21:12.591946 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 695/1400] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 2 09:21:12 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:13.829660 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-e82167e1-bfd1-4aed-ac78-afd6a62d5fe2 req-92afd177-4619-4fba-aa84-b64bada87d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13612e0f-d519-49c2-a5a3-781b032c9711", "tag": "f60aa2dc-d082-482d-9393-230f8d31e53e"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:13.840332 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-e82167e1-bfd1-4aed-ac78-afd6a62d5fe2 req-92afd177-4619-4fba-aa84-b64bada87d4b service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.840858 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-e82167e1-bfd1-4aed-ac78-afd6a62d5fe2 req-92afd177-4619-4fba-aa84-b64bada87d4b service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.853161 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-e82167e1-bfd1-4aed-ac78-afd6a62d5fe2 req-92afd177-4619-4fba-aa84-b64bada87d4b service nova] Creating event network-changed:f60aa2dc-d082-482d-9393-230f8d31e53e for instance 13612e0f-d519-49c2-a5a3-781b032c9711 on hv-cinder-84713 Aug 02 09:21:13.858831 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-e82167e1-bfd1-4aed-ac78-afd6a62d5fe2 req-92afd177-4619-4fba-aa84-b64bada87d4b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032830 Aug 02 09:21:13.859431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 706/1401] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:28.791000 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:28.791758 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:28.795918 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e16680c4-0317-40ed-b14b-c81b8dc68f38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:28.796406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e16680c4-0317-40ed-b14b-c81b8dc68f38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:28.802323 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e16680c4-0317-40ed-b14b-c81b8dc68f38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:28.809646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e16680c4-0317-40ed-b14b-c81b8dc68f38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:28.809646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e16680c4-0317-40ed-b14b-c81b8dc68f38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:28.809646 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e16680c4-0317-40ed-b14b-c81b8dc68f38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:28.826794 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e16680c4-0317-40ed-b14b-c81b8dc68f38 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/ips" status: 200 len: 146 microversion: 2.1 time: 0.037799 Aug 02 09:22:28.827359 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 696/1402] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 2 09:22:28 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:30.102644 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:30.103449 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=70 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:30.107002 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-8f65cb0a-3b5c-424b-b23e-5dd82bac7978 req-6707bc10-7b58-44bf-99f1-306aa34fbc2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f0a27d-cdc0-4355-a295-edf59d4ffa05", "tag": "e79c2678-5fc2-4bdf-9965-eade0f761a7e"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:30.108582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-b975d692-41d2-4cff-971e-71cc93d3a32f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:30.109294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b975d692-41d2-4cff-971e-71cc93d3a32f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:30.118917 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b975d692-41d2-4cff-971e-71cc93d3a32f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.121146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b975d692-41d2-4cff-971e-71cc93d3a32f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.121146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b975d692-41d2-4cff-971e-71cc93d3a32f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.121146 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-b975d692-41d2-4cff-971e-71cc93d3a32f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.121493 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-8f65cb0a-3b5c-424b-b23e-5dd82bac7978 req-6707bc10-7b58-44bf-99f1-306aa34fbc2a service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.121933 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-8f65cb0a-3b5c-424b-b23e-5dd82bac7978 req-6707bc10-7b58-44bf-99f1-306aa34fbc2a service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.134728 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-8f65cb0a-3b5c-424b-b23e-5dd82bac7978 req-6707bc10-7b58-44bf-99f1-306aa34fbc2a service nova] Creating event network-changed:e79c2678-5fc2-4bdf-9965-eade0f761a7e for instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 on hv-cinder-84713 Aug 02 09:22:30.140339 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-8f65cb0a-3b5c-424b-b23e-5dd82bac7978 req-6707bc10-7b58-44bf-99f1-306aa34fbc2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037678 Aug 02 09:22:30.144008 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 697/1403] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:22:30.149486 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-b975d692-41d2-4cff-971e-71cc93d3a32f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:22:30.415057 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-b975d692-41d2-4cff-971e-71cc93d3a32f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 204 len: 0 microversion: 2.1 time: 0.314749 Aug 02 09:22:30.415639 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 707/1404] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:22:30 2022] DELETE /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:22:30.426114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-469b1cf2-f8e6-4f43-ad7f-a0667912dfe6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:30.426918 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-469b1cf2-f8e6-4f43-ad7f-a0667912dfe6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:30.434457 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-469b1cf2-f8e6-4f43-ad7f-a0667912dfe6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.435211 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-469b1cf2-f8e6-4f43-ad7f-a0667912dfe6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.435896 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-469b1cf2-f8e6-4f43-ad7f-a0667912dfe6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.436399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-469b1cf2-f8e6-4f43-ad7f-a0667912dfe6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.658973 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-469b1cf2-f8e6-4f43-ad7f-a0667912dfe6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:30.667398 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-469b1cf2-f8e6-4f43-ad7f-a0667912dfe6 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1579 microversion: 2.1 time: 0.246793 Aug 02 09:22:30.667969 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 698/1405] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:30 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1579 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:31.576807 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-a4726ef2-a60d-4721-889c-10738b413793 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cb163ce-4ba8-4614-a67d-e0399b39c56c"}} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:31.579284 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-a4726ef2-a60d-4721-889c-10738b413793 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:31.586501 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a4726ef2-a60d-4721-889c-10738b413793 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.586960 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a4726ef2-a60d-4721-889c-10738b413793 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.587732 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a4726ef2-a60d-4721-889c-10738b413793 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.588170 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-a4726ef2-a60d-4721-889c-10738b413793 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.697355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-421d6937-8a26-4b47-92b2-8a7434dc4827 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:31.697355 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-421d6937-8a26-4b47-92b2-8a7434dc4827 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:31.699223 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-421d6937-8a26-4b47-92b2-8a7434dc4827 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.699871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-421d6937-8a26-4b47-92b2-8a7434dc4827 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.701939 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-421d6937-8a26-4b47-92b2-8a7434dc4827 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.703466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-421d6937-8a26-4b47-92b2-8a7434dc4827 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:32.122902 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-421d6937-8a26-4b47-92b2-8a7434dc4827 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:32.130914 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-421d6937-8a26-4b47-92b2-8a7434dc4827 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1579 microversion: 2.1 time: 0.445189 Aug 02 09:22:32.131484 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 699/1406] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:31 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1579 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:32.543857 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-a4726ef2-a60d-4721-889c-10738b413793 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.971522 Aug 02 09:22:32.544469 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 708/1407] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:22:31 2022] POST /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:33.151836 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-f35c06e6-1429-47e6-9dac-14dcc0e113f4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:33.152456 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-f35c06e6-1429-47e6-9dac-14dcc0e113f4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:33.159731 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f35c06e6-1429-47e6-9dac-14dcc0e113f4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.160233 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f35c06e6-1429-47e6-9dac-14dcc0e113f4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:33.160728 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-4ddb5ccb-f7a3-4002-a872-d06038dfc4e6 req-8c159bcb-b53e-40f4-a200-7c6c51cbc40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f0a27d-cdc0-4355-a295-edf59d4ffa05", "name": "network-vif-deleted", "tag": "e79c2678-5fc2-4bdf-9965-eade0f761a7e"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:33.162192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f35c06e6-1429-47e6-9dac-14dcc0e113f4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.162192 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-f35c06e6-1429-47e6-9dac-14dcc0e113f4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:33.172517 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-4ddb5ccb-f7a3-4002-a872-d06038dfc4e6 req-8c159bcb-b53e-40f4-a200-7c6c51cbc40d service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.172961 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-4ddb5ccb-f7a3-4002-a872-d06038dfc4e6 req-8c159bcb-b53e-40f4-a200-7c6c51cbc40d service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:33.184341 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-4ddb5ccb-f7a3-4002-a872-d06038dfc4e6 req-8c159bcb-b53e-40f4-a200-7c6c51cbc40d service nova] Creating event network-vif-deleted:e79c2678-5fc2-4bdf-9965-eade0f761a7e for instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 on hv-cinder-84713 Aug 02 09:22:33.189156 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-4ddb5ccb-f7a3-4002-a872-d06038dfc4e6 req-8c159bcb-b53e-40f4-a200-7c6c51cbc40d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Aug 02 09:22:33.190241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 709/1408] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:22:33.232737 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-f35c06e6-1429-47e6-9dac-14dcc0e113f4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:33.240585 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-f35c06e6-1429-47e6-9dac-14dcc0e113f4 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1392 microversion: 2.1 time: 0.092444 Aug 02 09:22:33.246001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 700/1409] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:33 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1392 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:34.261514 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:34.262238 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:34.268452 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:34.268908 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:34.269673 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:34.270140 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:34.301226 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:34.302485 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:34.302930 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.objects.instance [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lazy-loading 'fault' on Instance uuid 97f0a27d-cdc0-4355-a295-edf59d4ffa05 {{(pid=118366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:22:34.347482 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:34.355856 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8870d770-7919-4004-a2b7-0699037c3264 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 200 len: 1230 microversion: 2.1 time: 0.098934 Aug 02 09:22:34.356873 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 710/1410] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:34 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:35.377120 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:35.377722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 97f0a27d-cdc0-4355-a295-edf59d4ffa05] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:35.384866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:35.385313 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:35.386127 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:35.386560 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:35.399426 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] HTTP exception thrown: Instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 could not be found. Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Request method failure captured: Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 HTTP/1.1 Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OrDjZshGh3TStgxhZdrccntPxl6wsUfoo_lBLA9F02EyYjtV7IbB5ccRp82LoIKBJ3uFtzmoB3wWHafwLDPRdQN-yGg4nmW9hE7u23GBoQdx-9H9NN1M3Ca1pXJp5eq7zqEOoqnJLKVpdfB3HDFax8s6zrFd_xrCLLS8XQNHkLZDys Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:22:35.401023 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d65888d17d2e439592600a4e9305eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 02569c995a6d4b678933599f60ad3909 Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 could not be found. Aug 02 09:22:35.402863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '97f0a27d-cdc0-4355-a295-edf59d4ffa05'} Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 could not be found. Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:22:35.404034 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 could not be found. Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 could not be found. Aug 02 09:22:35.405813 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:22:35.407470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Returning 404 to user: Instance 97f0a27d-cdc0-4355-a295-edf59d4ffa05 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:22:35.407470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-54bf9166-6f15-4167-ba42-7e8844a30404 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05" status: 404 len: 111 microversion: 2.1 time: 0.029132 Aug 02 09:22:35.407470 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 701/1411] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:35 2022] GET /compute/v2.1/servers/97f0a27d-cdc0-4355-a295-edf59d4ffa05 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:38.753573 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [req-08b620e1-81d3-49dd-bb60-ae1ff14e3961 req-ca10f030-c0aa-4591-a546-d00e34e30273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84201b1d-a6e9-4de9-a793-9c6066555bfe", "tag": "f6ec0826-e49f-499a-a8e4-e5a74769a605"}]} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:38.759656 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-3a0dcd61-3f15-4299-a497-f1f2384d717f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:38.760153 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3a0dcd61-3f15-4299-a497-f1f2384d717f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:38.767034 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3a0dcd61-3f15-4299-a497-f1f2384d717f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.767563 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3a0dcd61-3f15-4299-a497-f1f2384d717f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.768413 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3a0dcd61-3f15-4299-a497-f1f2384d717f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.768919 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-3a0dcd61-3f15-4299-a497-f1f2384d717f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.769365 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-08b620e1-81d3-49dd-bb60-ae1ff14e3961 req-ca10f030-c0aa-4591-a546-d00e34e30273 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.769801 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [req-08b620e1-81d3-49dd-bb60-ae1ff14e3961 req-ca10f030-c0aa-4591-a546-d00e34e30273 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.782734 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.compute.server_external_events [req-08b620e1-81d3-49dd-bb60-ae1ff14e3961 req-ca10f030-c0aa-4591-a546-d00e34e30273 service nova] Creating event network-changed:f6ec0826-e49f-499a-a8e4-e5a74769a605 for instance 84201b1d-a6e9-4de9-a793-9c6066555bfe on hv-cinder-84713 Aug 02 09:22:38.787748 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [req-08b620e1-81d3-49dd-bb60-ae1ff14e3961 req-ca10f030-c0aa-4591-a546-d00e34e30273 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038852 Aug 02 09:22:38.788660 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 702/1412] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:38.798704 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-3a0dcd61-3f15-4299-a497-f1f2384d717f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:22:39.059098 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-3a0dcd61-3f15-4299-a497-f1f2384d717f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "DELETE /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 204 len: 0 microversion: 2.1 time: 0.312805 Aug 02 09:22:39.061758 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 711/1413] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:22:38 2022] DELETE /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:22:39.068871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-55e5f4ba-8c93-4a00-abea-cd3f17e315c5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:39.069559 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-55e5f4ba-8c93-4a00-abea-cd3f17e315c5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:39.075820 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-55e5f4ba-8c93-4a00-abea-cd3f17e315c5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:39.076266 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-55e5f4ba-8c93-4a00-abea-cd3f17e315c5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:39.077017 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-55e5f4ba-8c93-4a00-abea-cd3f17e315c5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:39.077444 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-55e5f4ba-8c93-4a00-abea-cd3f17e315c5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:39.215399 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-55e5f4ba-8c93-4a00-abea-cd3f17e315c5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:39.223244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-55e5f4ba-8c93-4a00-abea-cd3f17e315c5 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1579 microversion: 2.1 time: 0.159055 Aug 02 09:22:39.224028 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 703/1414] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:39 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:40.245597 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-846940a0-6a47-4589-9ded-7ee95bd95466 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:40.246239 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-846940a0-6a47-4589-9ded-7ee95bd95466 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:40.252842 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-846940a0-6a47-4589-9ded-7ee95bd95466 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:40.253291 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-846940a0-6a47-4589-9ded-7ee95bd95466 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:40.254091 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-846940a0-6a47-4589-9ded-7ee95bd95466 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:40.254523 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-846940a0-6a47-4589-9ded-7ee95bd95466 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:40.385997 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-846940a0-6a47-4589-9ded-7ee95bd95466 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:40.393502 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-846940a0-6a47-4589-9ded-7ee95bd95466 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1579 microversion: 2.1 time: 0.152202 Aug 02 09:22:40.394098 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 712/1415] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:40 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:41.416199 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-36fdaca1-af3f-4cae-8978-5b1e881ca792 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:41.417021 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-36fdaca1-af3f-4cae-8978-5b1e881ca792 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:41.423606 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36fdaca1-af3f-4cae-8978-5b1e881ca792 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:41.424081 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36fdaca1-af3f-4cae-8978-5b1e881ca792 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:41.424844 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36fdaca1-af3f-4cae-8978-5b1e881ca792 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:41.425278 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-36fdaca1-af3f-4cae-8978-5b1e881ca792 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:41.610441 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-36fdaca1-af3f-4cae-8978-5b1e881ca792 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:41.618095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-36fdaca1-af3f-4cae-8978-5b1e881ca792 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1460 microversion: 2.1 time: 0.206403 Aug 02 09:22:41.618666 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 704/1416] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:41 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1460 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:41.774663 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-ba30183e-626b-46f7-a937-3a00fbc64272 req-14c91366-a3c6-429c-9fe1-add04e66a3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84201b1d-a6e9-4de9-a793-9c6066555bfe", "name": "network-vif-deleted", "tag": "f6ec0826-e49f-499a-a8e4-e5a74769a605"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:41.784976 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-ba30183e-626b-46f7-a937-3a00fbc64272 req-14c91366-a3c6-429c-9fe1-add04e66a3fd service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:41.785422 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-ba30183e-626b-46f7-a937-3a00fbc64272 req-14c91366-a3c6-429c-9fe1-add04e66a3fd service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:41.796425 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-ba30183e-626b-46f7-a937-3a00fbc64272 req-14c91366-a3c6-429c-9fe1-add04e66a3fd service nova] Creating event network-vif-deleted:f6ec0826-e49f-499a-a8e4-e5a74769a605 for instance 84201b1d-a6e9-4de9-a793-9c6066555bfe on hv-cinder-84713 Aug 02 09:22:41.801212 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-ba30183e-626b-46f7-a937-3a00fbc64272 req-14c91366-a3c6-429c-9fe1-add04e66a3fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031227 Aug 02 09:22:41.801779 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 713/1417] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:42.212637 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-8aec722a-5b1f-42c8-811f-fa8c08c28b9d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:42.216705 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-8aec722a-5b1f-42c8-811f-fa8c08c28b9d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:42.221063 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8aec722a-5b1f-42c8-811f-fa8c08c28b9d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.221518 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8aec722a-5b1f-42c8-811f-fa8c08c28b9d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.222314 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8aec722a-5b1f-42c8-811f-fa8c08c28b9d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.222800 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-8aec722a-5b1f-42c8-811f-fa8c08c28b9d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.252410 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-8aec722a-5b1f-42c8-811f-fa8c08c28b9d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Aug 02 09:22:42.252962 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 705/1418] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:22:42 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:42.264965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-e8fd3f2a-5d8f-49ed-b50b-fd7e1077a568 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:42.265537 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-e8fd3f2a-5d8f-49ed-b50b-fd7e1077a568 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:42.271844 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e8fd3f2a-5d8f-49ed-b50b-fd7e1077a568 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.272294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e8fd3f2a-5d8f-49ed-b50b-fd7e1077a568 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.273056 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e8fd3f2a-5d8f-49ed-b50b-fd7e1077a568 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.273509 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-e8fd3f2a-5d8f-49ed-b50b-fd7e1077a568 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.308354 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-e8fd3f2a-5d8f-49ed-b50b-fd7e1077a568 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/5cb163ce-4ba8-4614-a67d-e0399b39c56c" status: 200 len: 194 microversion: 2.1 time: 0.040926 Aug 02 09:22:42.308354 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 714/1419] 10.222.0.46 () {58 vars in 1413 bytes} [Tue Aug 2 09:22:42 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/5cb163ce-4ba8-4614-a67d-e0399b39c56c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:42.639114 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:42.639748 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:42.646242 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.646685 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.647444 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.647863 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.681269 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.681722 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.682196 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lazy-loading 'fault' on Instance uuid 84201b1d-a6e9-4de9-a793-9c6066555bfe {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:22:42.725572 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02569c995a6d4b678933599f60ad3909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65888d17d2e439592600a4e9305eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:42.733224 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-0a0bf092-5ccb-4b97-8cc7-2bbaa431b0cb tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 200 len: 1230 microversion: 2.1 time: 0.097974 Aug 02 09:22:42.734131 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 706/1420] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:42 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:43.761196 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:43.761797 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 84201b1d-a6e9-4de9-a793-9c6066555bfe] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:43.768209 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.768810 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.769583 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.770045 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.783328 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] HTTP exception thrown: Instance 84201b1d-a6e9-4de9-a793-9c6066555bfe could not be found. Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Request method failure captured: Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe HTTP/1.1 Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OrDjZshGh3TStgxhZdrccntPxl6wsUfoo_lBLA9F02EyYjtV7IbB5ccRp82LoIKBJ3uFtzmoB3wWHafwLDPRdQN-yGg4nmW9hE7u23GBoQdx-9H9NN1M3Ca1pXJp5eq7zqEOoqnJLKVpdfB3HDFax8s6zrFd_xrCLLS8XQNHkLZDys Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:22:43.785784 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d65888d17d2e439592600a4e9305eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 02569c995a6d4b678933599f60ad3909 Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 84201b1d-a6e9-4de9-a793-9c6066555bfe could not be found. Aug 02 09:22:43.787584 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '84201b1d-a6e9-4de9-a793-9c6066555bfe'} Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84201b1d-a6e9-4de9-a793-9c6066555bfe could not be found. Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:22:43.788817 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84201b1d-a6e9-4de9-a793-9c6066555bfe could not be found. Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84201b1d-a6e9-4de9-a793-9c6066555bfe could not be found. Aug 02 09:22:43.790480 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:43.791942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Returning 404 to user: Instance 84201b1d-a6e9-4de9-a793-9c6066555bfe could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:22:43.791942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-564e7a74-5404-44e6-8590-d77b5a094022 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe" status: 404 len: 111 microversion: 2.1 time: 0.028906 Aug 02 09:22:43.791942 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 715/1421] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:43 2022] GET /compute/v2.1/servers/84201b1d-a6e9-4de9-a793-9c6066555bfe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:43.877146 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-01b2feaf-d545-4b5f-a23b-f80ca82c15ac tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71a70a14-0081-41d0-adef-9af50b5a168c"}} {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:43.879561 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-01b2feaf-d545-4b5f-a23b-f80ca82c15ac tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:43.886717 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-01b2feaf-d545-4b5f-a23b-f80ca82c15ac tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.887256 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-01b2feaf-d545-4b5f-a23b-f80ca82c15ac tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.888087 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-01b2feaf-d545-4b5f-a23b-f80ca82c15ac tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.888599 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-01b2feaf-d545-4b5f-a23b-f80ca82c15ac tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.301341 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:44.302448 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:44.308793 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.312886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.312886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.312886 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.323681 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] HTTP exception thrown: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Request method failure captured: Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 HTTP/1.1 Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OrDjZshGh3TStgxhZdrccntPxl6wsUfoo_lBLA9F02EyYjtV7IbB5ccRp82LoIKBJ3uFtzmoB3wWHafwLDPRdQN-yGg4nmW9hE7u23GBoQdx-9H9NN1M3Ca1pXJp5eq7zqEOoqnJLKVpdfB3HDFax8s6zrFd_xrCLLS8XQNHkLZDys Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:22:44.325259 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d65888d17d2e439592600a4e9305eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 02569c995a6d4b678933599f60ad3909 Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.327082 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '370371b8-72c0-4cc6-941c-6a5f6b6c1259'} Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:22:44.328278 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.330125 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.331821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Returning 404 to user: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:22:44.331821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-f8dd2308-39c4-4b06-9f8e-9c6ec983b874 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "DELETE /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 404 len: 111 microversion: 2.1 time: 0.029232 Aug 02 09:22:44.331821 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 716/1422] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:22:44 2022] DELETE /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:22:44.336745 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:44.340682 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] [instance: 370371b8-72c0-4cc6-941c-6a5f6b6c1259] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:44.343945 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.344437 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.345245 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.345721 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.359904 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] HTTP exception thrown: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Request method failure captured: Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 HTTP/1.1 Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OrDjZshGh3TStgxhZdrccntPxl6wsUfoo_lBLA9F02EyYjtV7IbB5ccRp82LoIKBJ3uFtzmoB3wWHafwLDPRdQN-yGg4nmW9hE7u23GBoQdx-9H9NN1M3Ca1pXJp5eq7zqEOoqnJLKVpdfB3HDFax8s6zrFd_xrCLLS8XQNHkLZDys Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:22:44.363722 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d65888d17d2e439592600a4e9305eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d65888d17d2e439592600a4e9305eeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: d65888d17d2e439592600a4e9305eeed Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-TestVolumeBootPattern-796762873 Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 02569c995a6d4b678933599f60ad3909 Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-TestVolumeBootPattern-796762873-project Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.366159 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '370371b8-72c0-4cc6-941c-6a5f6b6c1259'} Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:22:44.367468 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. Aug 02 09:22:44.369198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:22:44.370868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Returning 404 to user: Instance 370371b8-72c0-4cc6-941c-6a5f6b6c1259 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:22:44.370868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-6b5719a6-835f-463b-a85d-c4e44b412de0 tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259" status: 404 len: 111 microversion: 2.1 time: 0.031366 Aug 02 09:22:44.370868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 717/1423] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:44 2022] GET /compute/v2.1/servers/370371b8-72c0-4cc6-941c-6a5f6b6c1259 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:44.583944 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-01b2feaf-d545-4b5f-a23b-f80ca82c15ac tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "POST /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710169 Aug 02 09:22:44.584538 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 707/1424] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 2 09:22:43 2022] POST /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:45.830423 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-50958b55-b763-4593-b974-db5475b5fa5f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] Calling method '.version_select at 0x7f0f2fce58b0>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:45.906143 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-50958b55-b763-4593-b974-db5475b5fa5f tempest-TestVolumeBootPattern-796762873 tempest-TestVolumeBootPattern-796762873-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-950545340" status: 202 len: 0 microversion: 2.1 time: 0.079484 Aug 02 09:22:45.906860 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 718/1425] 10.222.0.46 () {58 vars in 1260 bytes} [Tue Aug 2 09:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-950545340 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:22:53.189340 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-b7f5908e-2252-4702-b7c4-ac633468df20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:53.191686 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-b7f5908e-2252-4702-b7c4-ac633468df20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:53.199533 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7f5908e-2252-4702-b7c4-ac633468df20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:53.200214 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7f5908e-2252-4702-b7c4-ac633468df20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:53.200999 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7f5908e-2252-4702-b7c4-ac633468df20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:53.201436 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-b7f5908e-2252-4702-b7c4-ac633468df20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:53.234848 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-b7f5908e-2252-4702-b7c4-ac633468df20 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050296 Aug 02 09:22:53.235420 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 708/1426] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:22:53 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:53.387363 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-42dff1bc-c93e-41f0-986d-94d01b4c4f5d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:53.389556 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-42dff1bc-c93e-41f0-986d-94d01b4c4f5d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:53.394751 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42dff1bc-c93e-41f0-986d-94d01b4c4f5d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:53.395198 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42dff1bc-c93e-41f0-986d-94d01b4c4f5d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:53.395946 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42dff1bc-c93e-41f0-986d-94d01b4c4f5d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:53.396898 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-42dff1bc-c93e-41f0-986d-94d01b4c4f5d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:53.425697 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-42dff1bc-c93e-41f0-986d-94d01b4c4f5d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/5cb163ce-4ba8-4614-a67d-e0399b39c56c" status: 200 len: 194 microversion: 2.1 time: 0.042927 Aug 02 09:22:53.426294 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 719/1427] 10.222.0.46 () {58 vars in 1413 bytes} [Tue Aug 2 09:22:53 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/5cb163ce-4ba8-4614-a67d-e0399b39c56c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:53.437095 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-19f149f1-94a8-4450-a9ff-73fe854ba2d3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:53.437586 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-19f149f1-94a8-4450-a9ff-73fe854ba2d3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:53.443680 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-19f149f1-94a8-4450-a9ff-73fe854ba2d3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:53.444124 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-19f149f1-94a8-4450-a9ff-73fe854ba2d3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:53.444871 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-19f149f1-94a8-4450-a9ff-73fe854ba2d3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:53.445376 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-19f149f1-94a8-4450-a9ff-73fe854ba2d3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:53.529598 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-19f149f1-94a8-4450-a9ff-73fe854ba2d3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lazy-loading 'services' on Instance uuid 13612e0f-d519-49c2-a5a3-781b032c9711 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:22:53.716751 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-19f149f1-94a8-4450-a9ff-73fe854ba2d3 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/5cb163ce-4ba8-4614-a67d-e0399b39c56c" status: 202 len: 0 microversion: 2.1 time: 0.283582 Aug 02 09:22:53.717472 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 709/1428] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:22:53 2022] DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/5cb163ce-4ba8-4614-a67d-e0399b39c56c => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:22:55.891118 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8d8b5edc-74d2-4f0d-9a6a-d11d2d49b443 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:55.891645 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8d8b5edc-74d2-4f0d-9a6a-d11d2d49b443 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:55.898578 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8d8b5edc-74d2-4f0d-9a6a-d11d2d49b443 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.899029 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8d8b5edc-74d2-4f0d-9a6a-d11d2d49b443 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.899791 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8d8b5edc-74d2-4f0d-9a6a-d11d2d49b443 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.900228 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8d8b5edc-74d2-4f0d-9a6a-d11d2d49b443 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.928990 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8d8b5edc-74d2-4f0d-9a6a-d11d2d49b443 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/71a70a14-0081-41d0-adef-9af50b5a168c" status: 200 len: 194 microversion: 2.1 time: 0.041691 Aug 02 09:22:55.929577 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 720/1429] 10.222.0.46 () {58 vars in 1413 bytes} [Tue Aug 2 09:22:55 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/71a70a14-0081-41d0-adef-9af50b5a168c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:55.940997 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e990af33-e4fd-4bec-bc92-5108fb1c56fb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:55.942077 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e990af33-e4fd-4bec-bc92-5108fb1c56fb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:55.948406 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e990af33-e4fd-4bec-bc92-5108fb1c56fb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.948861 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e990af33-e4fd-4bec-bc92-5108fb1c56fb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.949630 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e990af33-e4fd-4bec-bc92-5108fb1c56fb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.950098 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e990af33-e4fd-4bec-bc92-5108fb1c56fb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:56.028961 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-e990af33-e4fd-4bec-bc92-5108fb1c56fb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lazy-loading 'services' on Instance uuid 13612e0f-d519-49c2-a5a3-781b032c9711 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:22:56.235270 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e990af33-e4fd-4bec-bc92-5108fb1c56fb tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/71a70a14-0081-41d0-adef-9af50b5a168c" status: 202 len: 0 microversion: 2.1 time: 0.298816 Aug 02 09:22:56.235866 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 710/1430] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 2 09:22:55 2022] DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments/71a70a14-0081-41d0-adef-9af50b5a168c => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:22:57.405348 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0d56bdbd-4bcf-4619-ba44-6742a6df3830 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:57.407618 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0d56bdbd-4bcf-4619-ba44-6742a6df3830 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:57.414147 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d56bdbd-4bcf-4619-ba44-6742a6df3830 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.414549 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d56bdbd-4bcf-4619-ba44-6742a6df3830 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.415315 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d56bdbd-4bcf-4619-ba44-6742a6df3830 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.415753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0d56bdbd-4bcf-4619-ba44-6742a6df3830 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.446855 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0d56bdbd-4bcf-4619-ba44-6742a6df3830 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045412 Aug 02 09:22:57.447330 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 721/1431] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:22:57 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:22:57.561501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-68110097-caa2-4cfc-b914-646dc22a5e09 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:57.563742 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-68110097-caa2-4cfc-b914-646dc22a5e09 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:57.569867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-68110097-caa2-4cfc-b914-646dc22a5e09 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.570346 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-68110097-caa2-4cfc-b914-646dc22a5e09 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.571108 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-68110097-caa2-4cfc-b914-646dc22a5e09 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.571542 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-68110097-caa2-4cfc-b914-646dc22a5e09 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.595202 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:57.599747 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-68110097-caa2-4cfc-b914-646dc22a5e09 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042450 Aug 02 09:22:57.600298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 711/1432] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 2 09:22:57 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:22:57.659868 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-ca1b818c-2426-45e1-b6d6-567bae8426f6 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:57.660442 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ca1b818c-2426-45e1-b6d6-567bae8426f6 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:57.666941 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ca1b818c-2426-45e1-b6d6-567bae8426f6 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.667394 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ca1b818c-2426-45e1-b6d6-567bae8426f6 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.668192 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ca1b818c-2426-45e1-b6d6-567bae8426f6 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.668628 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-ca1b818c-2426-45e1-b6d6-567bae8426f6 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.693501 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-ca1b818c-2426-45e1-b6d6-567bae8426f6 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Going to try to terminate instance {{(pid=118366) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:22:57.696544 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:58.013108 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-ca1b818c-2426-45e1-b6d6-567bae8426f6 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 204 len: 0 microversion: 2.1 time: 0.356815 Aug 02 09:22:58.013741 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 722/1433] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:22:57 2022] DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:22:58.023628 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-3782bcda-e734-4d86-abcc-6627c77cb06d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:58.024239 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-3782bcda-e734-4d86-abcc-6627c77cb06d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:58.030594 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3782bcda-e734-4d86-abcc-6627c77cb06d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:58.034428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3782bcda-e734-4d86-abcc-6627c77cb06d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:58.034428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3782bcda-e734-4d86-abcc-6627c77cb06d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:58.034428 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-3782bcda-e734-4d86-abcc-6627c77cb06d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:58.160972 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-3782bcda-e734-4d86-abcc-6627c77cb06d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:58.169183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-3782bcda-e734-4d86-abcc-6627c77cb06d tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1673 microversion: 2.1 time: 0.150957 Aug 02 09:22:58.169750 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 712/1434] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:58 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:59.191105 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-8ce57424-ca45-4c97-b60c-5ed6064f6a17 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:59.191718 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-8ce57424-ca45-4c97-b60c-5ed6064f6a17 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:59.198280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8ce57424-ca45-4c97-b60c-5ed6064f6a17 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:59.198685 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8ce57424-ca45-4c97-b60c-5ed6064f6a17 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:59.199498 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8ce57424-ca45-4c97-b60c-5ed6064f6a17 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:59.199926 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-8ce57424-ca45-4c97-b60c-5ed6064f6a17 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:59.331283 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.policy [None req-8ce57424-ca45-4c97-b60c-5ed6064f6a17 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118366) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:59.339331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-8ce57424-ca45-4c97-b60c-5ed6064f6a17 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1673 microversion: 2.1 time: 0.152569 Aug 02 09:22:59.339891 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 723/1435] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:59 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:00.360596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-56680f34-c183-4585-b2f8-ca1e22db218b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:00.361204 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-56680f34-c183-4585-b2f8-ca1e22db218b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:00.367648 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-56680f34-c183-4585-b2f8-ca1e22db218b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:00.368099 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-56680f34-c183-4585-b2f8-ca1e22db218b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:00.368867 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-56680f34-c183-4585-b2f8-ca1e22db218b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:00.369305 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-56680f34-c183-4585-b2f8-ca1e22db218b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:00.617543 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-56680f34-c183-4585-b2f8-ca1e22db218b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:00.625155 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-56680f34-c183-4585-b2f8-ca1e22db218b tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1673 microversion: 2.1 time: 0.268439 Aug 02 09:23:00.625877 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 713/1436] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:00 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:01.303826 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [req-be9e489b-23a0-453a-9eb4-8462b6600a83 req-18e7daac-1775-4b6f-a88f-88d803c2fb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13612e0f-d519-49c2-a5a3-781b032c9711", "name": "network-vif-deleted", "tag": "f60aa2dc-d082-482d-9393-230f8d31e53e"}]} {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:23:01.314567 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-be9e489b-23a0-453a-9eb4-8462b6600a83 req-18e7daac-1775-4b6f-a88f-88d803c2fb51 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:01.315374 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [req-be9e489b-23a0-453a-9eb4-8462b6600a83 req-18e7daac-1775-4b6f-a88f-88d803c2fb51 service nova] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.329362 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.compute.server_external_events [req-be9e489b-23a0-453a-9eb4-8462b6600a83 req-18e7daac-1775-4b6f-a88f-88d803c2fb51 service nova] Creating event network-vif-deleted:f60aa2dc-d082-482d-9393-230f8d31e53e for instance 13612e0f-d519-49c2-a5a3-781b032c9711 on hv-cinder-84713 Aug 02 09:23:01.334861 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [req-be9e489b-23a0-453a-9eb4-8462b6600a83 req-18e7daac-1775-4b6f-a88f-88d803c2fb51 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229517 Aug 02 09:23:01.335613 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 724/1437] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 2 09:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:23:01.647645 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:01.648288 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:01.650541 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG dbcounter [-] [118368] Writing DB stats nova_api:SELECT=39 {{(pid=118368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:01.655334 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:01.655783 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.656599 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:01.657029 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.688551 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:01.689001 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.689449 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.objects.instance [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lazy-loading 'fault' on Instance uuid 13612e0f-d519-49c2-a5a3-781b032c9711 {{(pid=118368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:23:01.734662 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.policy [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aff587ea964860895cd4dce03f2158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaca149a97a44cf84f9d21fa65510b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:01.742258 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-e8720325-776d-42db-8e4a-a8a1f3959592 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 200 len: 1327 microversion: 2.1 time: 0.099080 Aug 02 09:23:01.742828 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 714/1438] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:01 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:02.764102 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:02.764800 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:02.766792 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG dbcounter [-] [118366] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:02.771883 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:02.772331 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:02.773095 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:02.773534 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:02.786964 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] HTTP exception thrown: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Request method failure captured: Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 HTTP/1.1 Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OtHrrQzSMrJwBIbL-PRJMBqbH7LYsqGddoTGkFvzjqJE7oIOqQJFL0KG0KjZ-mOsyo_MifvCl43CjoazoSrCJIRqwjsN22YhlgyvA2twwaaGqM-nO0ok7TkKldo83Or5E3sTIi-0Km5bb8SY3p-T4d2vS8Aeq9ziegdhHQBJWHrWUU Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:23:02.794753 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 77aff587ea964860895cd4dce03f2158 Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:02.796627 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '13612e0f-d519-49c2-a5a3-781b032c9711'} Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:23:02.797679 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:02.799431 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:02.800994 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Returning 404 to user: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:23:02.800994 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-0a9fd300-fd26-46bb-b688-5a073eb1c2d2 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 404 len: 111 microversion: 2.1 time: 0.030588 Aug 02 09:23:02.800994 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 725/1439] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:02 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:23:02.801301 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-97abf69d-89f6-45b6-978f-cb01c6d0cf89 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '.version_select at 0x7f0f31eb21f0>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:02.876636 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-97abf69d-89f6-45b6-978f-cb01c6d0cf89 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-375746643" status: 202 len: 0 microversion: 2.1 time: 0.081697 Aug 02 09:23:02.877209 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 715/1440] 10.222.0.46 () {58 vars in 1218 bytes} [Tue Aug 2 09:23:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-375746643 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:23:06.029632 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:06.030173 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:06.036966 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:06.039535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:06.039535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:06.039535 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:06.052384 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] HTTP exception thrown: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Request method failure captured: Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 HTTP/1.1 Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OtHrrQzSMrJwBIbL-PRJMBqbH7LYsqGddoTGkFvzjqJE7oIOqQJFL0KG0KjZ-mOsyo_MifvCl43CjoazoSrCJIRqwjsN22YhlgyvA2twwaaGqM-nO0ok7TkKldo83Or5E3sTIi-0Km5bb8SY3p-T4d2vS8Aeq9ziegdhHQBJWHrWUU Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:23:06.054241 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 77aff587ea964860895cd4dce03f2158 Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.055965 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': '13612e0f-d519-49c2-a5a3-781b032c9711'} Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:23:06.057022 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.058662 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.060280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Returning 404 to user: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:23:06.060280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-d79e2ec4-756c-44a7-a6b3-f68843f36f5c tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 404 len: 111 microversion: 2.1 time: 0.030201 Aug 02 09:23:06.060280 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 726/1441] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:23:06 2022] DELETE /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:23:06.064532 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:06.065194 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: 13612e0f-d519-49c2-a5a3-781b032c9711] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:06.072298 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:06.072755 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:06.073516 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:06.073982 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:06.087597 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] HTTP exception thrown: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Request method failure captured: Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 HTTP/1.1 Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OtHrrQzSMrJwBIbL-PRJMBqbH7LYsqGddoTGkFvzjqJE7oIOqQJFL0KG0KjZ-mOsyo_MifvCl43CjoazoSrCJIRqwjsN22YhlgyvA2twwaaGqM-nO0ok7TkKldo83Or5E3sTIi-0Km5bb8SY3p-T4d2vS8Aeq9ziegdhHQBJWHrWUU Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:23:06.089207 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 77aff587ea964860895cd4dce03f2158 Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.090938 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': '13612e0f-d519-49c2-a5a3-781b032c9711'} Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:23:06.091798 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. Aug 02 09:23:06.093147 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:06.094466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Returning 404 to user: Instance 13612e0f-d519-49c2-a5a3-781b032c9711 could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:23:06.094466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-a862a6d4-8399-4fb7-b480-99e515b8edd0 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711" status: 404 len: 111 microversion: 2.1 time: 0.030570 Aug 02 09:23:06.094466 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 716/1442] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:06 2022] GET /compute/v2.1/servers/13612e0f-d519-49c2-a5a3-781b032c9711 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:23:07.456261 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:07.456729 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.compute.api [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118366) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:07.463955 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:07.464404 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:07.465174 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:07.465611 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG oslo_concurrency.lockutils [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:07.479471 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.wsgi [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] HTTP exception thrown: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Request method failure captured: Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: request: DELETE /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd HTTP/1.1 Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept: application/json Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Accept-Encoding: identity Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Connection: close Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Length: 0 Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Content-Type: application/json Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Host: 10.222.0.46 Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Openstack-System-Scope: None Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: User-Agent: python-urllib3/1.26.10 Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Auth-Token: gAAAAABi6OtHrrQzSMrJwBIbL-PRJMBqbH7LYsqGddoTGkFvzjqJE7oIOqQJFL0KG0KjZ-mOsyo_MifvCl43CjoazoSrCJIRqwjsN22YhlgyvA2twwaaGqM-nO0ok7TkKldo83Or5E3sTIi-0Km5bb8SY3p-T4d2vS8Aeq9ziegdhHQBJWHrWUU Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Id: None Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Domain-Name: None Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Identity-Status: Confirmed Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Is-Admin-Project: True Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Id: default Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Domain-Name: Default Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Project-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Role: member,reader Aug 02 09:23:07.480989 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Roles: member,reader Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Id: default Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Domain-Name: Default Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Id: 77aff587ea964860895cd4dce03f2158 Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: X-User-Name: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: method: > Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: exception: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.482773 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: action_args: {'id': 'e04e0dc0-229f-4f7e-a56b-582dcc6b64fd'} Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: {{(pid=118366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:23:07.483969 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.485641 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.487377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: DEBUG nova.api.openstack.wsgi [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Returning 404 to user: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. {{(pid=118366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:23:07.487377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO nova.api.openstack.requestlog [None req-c4e31134-59e8-4641-bcce-2c3cba7881e1 tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 404 len: 111 microversion: 2.1 time: 0.030391 Aug 02 09:23:07.487377 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: [pid: 118366|app: 0|req: 727/1443] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 2 09:23:07 2022] DELETE /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:23:07.490740 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Calling method '>' {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:07.491380 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.compute.api [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] [instance: e04e0dc0-229f-4f7e-a56b-582dcc6b64fd] Fetching instance by UUID {{(pid=118368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:07.498060 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:07.498501 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:07.499257 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:07.499718 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG oslo_concurrency.lockutils [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Lock "b5fe5474-0e15-44e4-8276-d3b5e9f77338" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:07.512596 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.wsgi [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] HTTP exception thrown: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Request method failure captured: Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: request: GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd HTTP/1.1 Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept: application/json Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Accept-Encoding: identity Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Connection: close Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Length: 0 Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Content-Type: application/json Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Host: 10.222.0.46 Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Openstack-System-Scope: None Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: User-Agent: python-urllib3/1.26.10 Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Auth-Token: gAAAAABi6OtHrrQzSMrJwBIbL-PRJMBqbH7LYsqGddoTGkFvzjqJE7oIOqQJFL0KG0KjZ-mOsyo_MifvCl43CjoazoSrCJIRqwjsN22YhlgyvA2twwaaGqM-nO0ok7TkKldo83Or5E3sTIi-0Km5bb8SY3p-T4d2vS8Aeq9ziegdhHQBJWHrWUU Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Id: None Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Domain-Name: None Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Identity-Status: Confirmed Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Is-Admin-Project: True Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Id: default Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Domain-Name: Default Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Project-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Role: member,reader Aug 02 09:23:07.514110 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Roles: member,reader Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bfaca149a97a44cf84f9d21fa65510b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Id: bfaca149a97a44cf84f9d21fa65510b6 Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486939081 Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Id: default Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Domain-Name: Default Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Id: 77aff587ea964860895cd4dce03f2158 Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: X-User-Name: tempest-AttachVolumeTestJSON-486939081-project Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: method: > Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: exception: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.515791 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: action_args: {'id': 'e04e0dc0-229f-4f7e-a56b-582dcc6b64fd'} Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: {{(pid=118368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:23:07.516608 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. Aug 02 09:23:07.518244 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: ERROR nova.api.openstack.wsgi Aug 02 09:23:07.519571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: DEBUG nova.api.openstack.wsgi [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] Returning 404 to user: Instance e04e0dc0-229f-4f7e-a56b-582dcc6b64fd could not be found. {{(pid=118368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:23:07.519571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO nova.api.openstack.requestlog [None req-d04c54f6-f3fb-4877-8b8b-85220bb2ad4e tempest-AttachVolumeTestJSON-486939081 tempest-AttachVolumeTestJSON-486939081-project] 10.222.0.46 "GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd" status: 404 len: 111 microversion: 2.1 time: 0.028537 Aug 02 09:23:07.519571 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: [pid: 118368|app: 0|req: 717/1444] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:07 2022] GET /compute/v2.1/servers/e04e0dc0-229f-4f7e-a56b-582dcc6b64fd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:23:11.893196 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:23:11.893835 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:23:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:25:43.198275 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:25:43.198891 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Tue Aug 2 09:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:26:31.902183 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:26:31.902844 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:26:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:26:35.747358 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:26:35.747958 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Tue Aug 2 09:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:28:08.304377 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:28:08.304950 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:28:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:28:08.944832 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:28:08.945317 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Tue Aug 2 09:28:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:28:28.848222 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:28:28.848793 dv-cinder-847131-4-iscsi devstack@n-api.service[118368]: Tue Aug 2 09:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:29:03.206582 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:29:03.207141 dv-cinder-847131-4-iscsi devstack@n-api.service[118366]: Tue Aug 2 09:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!